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FOREWORD 


This report is the first of three volumes constituting the 
final technical report completed under National Aeronautics and 
Space Administration Contract NAS2-5038, "Human Performance 
Prediction Tests." Dr. R. Mark Patton was the NASA Ames Research 
Center Technical Monitor. This study was performed as a part of 
the Human Factors Systems Program, Walton L. Jones, M.D., Director. 
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SUMMARY 


Over the past three decades there ms been an increasing demand for 
quantitative techniques of human performance prediction in man-machine 
system tasks. A somewhat bewildering variety of methods have evolved 
to satisfy this need, ranging from specific task simulation to classical 
tests of fundamental human abilities. 


The basic objective of this program was to review critically tests 
and test techniques for human performance prediction. Such a review, 
however, is best facilitated by conceptual and methodological criteria. 
At a very basic level, therefore, four fundamental questions were asked: 


1. To predict what? 

2. Upon what dimensions and measures? 
3. With what tools? 

4. For what purposes? 


Asking these questions of this literature exposed some serious and basic 
problems (Chapter A). 


At another level of analysis, tests must be related to human perfor- 
mance dimensions found in human operator tasks which are executed to help 
achieve system performance criteria. For tests to be meaningful in man- 
machine systems quantitative transformations must be possible between 
levels. This required mapping operation turns out to be a formidable 
technical challenge (see Chapter F). 


Both the questions and levels of analysis can be combined into a 
single conceptual structure, as shown in Figure 1. The question of 
purpose is external to this matrix, but each of the first three questions 
can be asked at each of the three levels. The addition of an analytic 
requirement to interrelate these levels results in a Generalized Metho- 
dological Model which can be (1) used to evaluate the existing literature 
and (2) form a framework of requirements for future test development. 


To test validly by any method assumes an understanding and descrip- 
tion of the phenomena to be tested. In man-machine system tasks, task 
taxonomies and task analysis methods are many but inadequate. Chapter B 
introduces a new method - the Meister Taxonomy - which is used throughout 
the program (and given a preliminary comparative evaluation against two 
other methods as reported in Appendix C). 


For methodological and evaluation purposes, it was decided that an 
actual behavioral sample was necessary. A hypothetical Extended Earth 
Orbital Scientific Laboratory was postulated, and detailed analyses made, 
at three levels, of: 


1. Rendezvous and docking 
2. Extravehicular activity (EVA) 


svsima SYSTEM ~ MAN 
Group and System Systen-Tagk Rejationship Test Battery 
Level of Analysis Level of Analysis Development 


System 
Criteria 


1s-m 
To predict what? 


System 
Performance 
Measures 


With what tools? Upon what measure 


Human 
Performance 
Dimensions 


ee 


With what tools? measures? 


With what tools? 


FIGURE 1. A generalized methodological model for 
human performance prediction. 
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3. EVA experiments 
4. Onboard scientific experiments. 


Both operational realism and a wide variety of behavioral examples were 
sought. (Examples of the analyses may be seen in Appendix B.) 


These analyses were used in a number of evaluation contexts, e.g., 
in the relations of system, task and behavior measures (Chapter F). But, 
perhaps the most anbitious undertaking was the detailed application of 
the human performance prediction methodology (developed from the approach 
implied by Figure 1) to a specific man-machine system activity: the 
celestial and space-object radiometry experiments conducted during the 
Gemini V and the Gemini VII missions. Several intensive analyses were 
performed at several levels to provide specific answers to the first 
three of the above four basic and essential questions. The analytic 
outputs were in the form required for our purpose, quantitative human 
performance prediction; i.e., terms capable of quantitative measure were 
specified and the relationships between system, system-man and the human 
operator levels of criterial performance were identified with respect 
to these terms. These relationships between the system, system-man and 
man Levels of analysis and the terms, i.e., the analytic outputs, are 
summarized in Appendix A within the framework represented by Figure lL. 


It was felt that the existing test Literature had to be incorporated 


- into some conceptual system emcompassing individual behavior (Chapter C), 


response to stressors (Chapter D), and small group performance (Chapter 
E). From the existing literature, 75 behavioral dimensions were defined 


and incorporated into a Performance Descriptor X Physical and Interactional 


Categories Matrix. Among other purposes, this matrix served a useful 
purpose of mapping performance dimensions into task dimensions (see 
Chapter C). 


The 75-dimension framework also provided a heuristic classification 
scheme for the existing test literature. In Volume IT, over 500 tests 
are classified and described*, all of which are potential candidates for 
man-machine system problems. 


Future development of test methods and test devices in the man- 
machine system area for human performance prediction must adhere to 
certain essential theoretical and methodological requirements (see 
Chapter G): 


* Detailed descriptions are given in Volume III as part of the selected 
and annotated bibliography of the 486 references reviewed in this 
program. 


vil 


1. A more precise understanding and description of system and 
behavioral phenomena must be accomplished; advances in test validity 
depend upon it. 


2. Prediction problems in this area are multi-dimensional and 
multi-level; the Human Performance Prediction Methodology developed here 
is offered as a guide. 


3. Future tests and test batteries developments must use modern 
test development techniques; utility analysis is particularly pertinent 
and applicable. 


Human performance prediction tests can serve a great potential 
future role in the understanding, prediction, and control of human 
performance in man-machine systems; but only to the degree that many 
current theoretical and methodological problems are resolved. 
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CHAPTER A: OVERVIEW AND TECHNICAL APPROACH 


A continuing and fundamental problem and need in the human factors 
field is the availability of methods by which precise predictions can be 
made of human performance in man-machine system tasks. The objective of 
the present program has been in general to review the current literature 
on human performance prediction and specifically the test devices which 
have been developed to make these predictions. 


This literature extends back well over three decades (cf., 88)¥* and 
it seems particularly useful at this time to evaluate the effectiveness 
of human performance prediction tests and test batteries. The goal of 
the program is three-fold: 


1. To indicate the issues involved in human performance prediction 
in man-machine systems; 


2. To analyze the published tests and test batteries that may 
apply to man-machine system prediction problems; and 


3. To suggest approaches by which future test developments may be 
guided. For example, for manned space flight applications, there has 
been much recent interest in developing simulation or onboard human 
performance test batteries (cf., 190, 360, 362, 373). 


That there are several serious theoretical, methodological, and 
research deficiencies in this area is a point that will be developed 
throughout this report. However, it also appears clear to us that there 
is a positive strategy for future work both to overcome these deficiencies 
as well as to make maximum utilization of existing data. As an indication 
of the problems we feel to be paramount, a short sample of the literature 
has been selected for comment. 


A Sample of the Current Test Literature 


Table A-1 lists some 20 references and citations covering what we 
consider to be a representative sample of the test literature currently 
available. Only certain salient features are described; additional 
information is provided in Volumes IT and III and, of course, the 
original sources are best consulted for a complete treatment. From the 
information contained in Table A~l, however, a number of comments may be 
made which appear to apply to this literature. 


* Throughout this volume, underlined numerical references refer to 
citations found in Volume IIT: A Selected and Annotated Bibliography. 


1. Tests range from single instruments (e.g., 403, 50, 36) to 
multiple test batteries (e.g., 360, 355, 351, 372, 190) to varying 
degrees of operational task simulation (e.g., 108, 410, 447). ‘There is 
no evidence of any standardized testing approach in this literature. 


2. The behavior tested ranges from simple sensory phenomena 
(e.g., 101) to psychomotor tasks (e.g., 403) to elaborate sets of human 
ability measurements (e.g., 82, 83, 355, 372) to operational performance 
(e.g-, 108, 447). There is no evidence of any standardized behavior 
classification scheme in this literature or of any attempt to consider 
basic behavioral categories across the wide range of human performance 
tasks in man-machine systems. 


3. System performance measurements are more noticeable by their 
absence than presence. Only where operational tasks are involved are 
system performance measures even considered, and even then are often not 
adequately measured or reported. 


4, The measurement of test validity is extremely rare. Much is 
made of high face validity and content validity with little concrete 
evidence that either is present. Only in a few cases are validity 
coefficients even reported (e.g., 50). Test validity in its classical 
sense is open to serious question in this entire literature. 


5. The majority of tests in this literature are used without direct 
derivation of test reliability data. Only in the more extensive test 
programs has reliability measurement been considered by the investigators 
as a basic and necessary step in test development (e.g., 360, 361, 351, 


96) - 


6. The majority of these tests are said to be sensitive to the 
effects of stressors on human performance. In most cases, this constitutes 
simply a demonstration that under some kind of stress situation (usually 
single dimension) performance changes occur. 


These points suggest at the least that this literature suffers 
from some very fundamental methodological problems. 
Four Basic Questions 
In reviewing this literature, it has become apparent that a more 


basic evaluation of the fundamental approach to human performance pre- 
diction might be in order. At least four general questions ought to be 


. asked. 


1. To Predict What? 


There appears to be a question in this literature as to just what © 
is being predicted. Much of the literature is directed toward studies 


of human capabilities and limitations without, however, any direct 
relevance to man-machine system applications. On the other hand, a 
significant portion of the literature (although certainly a minority) 
attacks immediately the applications context. 


At least three levels of prediction can be indicated: (1) individual 
performance without particular regard to the total man-machine task, (2) 
group performance extracted from the system task, and (3) final system 
performance measurement. Ideally, we would like to be able to predict 
quantitatively each of these three levels and the interrelationships 
between them. Since we are far from that objective, it would be parti- 
cularly useful if investigators indicated just what levels of prediction 
they are in fact attempting. 


At the individual and group performance levels, both in the presence 
and absence of stressors, we need to be able to define precisely the 
behavior we are trying to predict. This, in turn, requires some task 
taxonomy, or, at a minimum, some understanding by investigators of the 
definitions of the behavior exhibited by humans in man-machine systems. 

To use Miller's (15) distinction between task description and task 
analysis, we need a "...behavioral understanding (that is, an analysis) 

of the task requirements..." And we need rules by which data on these 
behavioral categories are related to final system performance measurement. 


As a specific example, we may refer once again to Table A~1 and 
select at random the behavioral dimensions said to be measured by these 
tests: 


Manual dexterity 
Tactual sensitivity 
Number retention 
Arithmetic computation 
Perceptual Style 
Tracking 

Memory 

Problem Solving 

Ete. 


Valid and reliable testing of these "dimensions" is a minor problem 
compared with the immense conceptual difficulty of relating these 
"dimensions" to actual human performance in man-machine system tasks. 


In the literature, one particular approach has been used that 
attempts to derive psychological performance dimensions (cf. oe 19), 
within the context of man-machine system tasks. Yet, this approach has 
been widely criticized on grounds which are not clear. Since the basic 
technique is factor analytic, perhaps much of this resistance is related 
to a general lack of confidence in this fundamental approach. Yet, in 


TABLE A-1 
A Representative Sample of the Man-Machine System Test Literature 


Adaptive Three-axis acceleration 


Adaptive training Testing 


training 


Embedded. 


Complex 
Coordinator 


Critical 
Tracking 
Task 


control task 
STRESS: No known data 


Perceptual style 

STRESS: EFT related to 
emergency behavior but 
not simulator sickness 


Discrete probability 
matching estimated to 


tap psychomotor, monitor~ 
ing and decision making, 


learning, memory, etc. 
STRESS: Hypoxia, 367: ; 
decompression, 3600 
alcohol, 376; aes 
histamines, 359 


Unstable first-order 
tracking task 
STRESS: No data known 


Two competing tasks; 
discrete and continous 
signals 

STRESS: assumes task- 
induced stress 


measures (37) 


Driving performance 


None, but said to 
imply information 
processing (bit-rate) 
measures 


Measurement set based 
on human operator 
describing function 


pilot 
skills 


Emergency 
behavior 
= oh 

9 


Not known 


Not known 
Comparison 
of mean 
data from 
test and 
criterion 
groups 


Not known 


Not known 


TABLE A-1 (Continued) 


Reference Test Name/ Tasks/or Socio- System Performance 
Number Description Psychological Dimensions Measures 


Complex 
Behavior 
Simulator 


Multiple 
Test 


Integrated 
Crew Monitoring! 
Test Battery 


(1) control panel, (2) None 

bimanual coordination, | 
(3) leg movement, (4) CFF, 

and (5) steadiness | 
STRESS: Sleep loss 


STRESS: confinement 
in small altitude 
chamber 


Tests of tactile sensi- 
tivity, grip strength, 
manual dexterity, 

tracking, group performance, 
mental arithmetic, symbol 
processing, simple problem 


we 
solving, and memory. 


STRESS: underwater performance 


RATER: symbol and 
color matching 
LOGIT: higher mental 
processes 

STRESS: simulated 

head rotation, 364, 365 


Physiological 
measurement plus (1) 
tracking task, (2) drift 
monitoring task, (3) arith- 
metic task, (4) pattern 
comparison task, (5) maze 
task. STRESS: pressure suit 


Validity 


Not known 


Not known 


Assumed to | 
have high | 
face 

validity 
to diver t 
tasks 


Said to be 
basic test 
device for 
stressors 
and basic 
abilities 


Said to 
represent 
manned 

space flight 
tasks 


Reliability 


Not 
specified 


Test-retest 
r= -.21 to 
+.96 


No data 
given 


No data 
given 
Normative 
data from 


368, 369 


r= .30-.90 


TABLE A-1 (Continued) 


Reference Test Name/ Tasks/or Socio- System Performance ae ie 
Number Description Psychological Dimensions Measures Validity Reliability 


oe) 

B5L Multiple 
Test 
Battery 

372 SINBAD 

190, 372 Multiple 
Test 
Battery 


COMPARE 


Warning light monitoring, 
arithmetic computation, 
target identification, 
code-lock solving, 
probability monitoring, 
and tracking. STRESS: 

no known studies. 


4 
Auditory vigilance, None 

warning-lights monitoring, 

probability matching, 

arithmetic computation, 

code-lock solving, target 

identification. STRESS: 

confinement and work~-rest 

cycles 


26 specific tests ranging None 
from simple reaction time 

to complex manual tracking, 
monitoring a simple display | 
to solving arithmetic and 
symbolic problems. STRESS 
designed for underwater 
performance measurement 


Tests of 18 ability None 
dimensions incorporated 
into a performance test 
panel. STRESS: assumed 
for space applications 


Assumed. 

to test 
crew 
performance 


Assumed 
to have 
high face 
validity 
with 
aircrew 
tasks 


Based on 
abilities 
analysis 
of under- 
water 
tasks 


Based on 
ability 
analysis 

of manned. 
space tasks 


No data 
given 


No specific 
data cited; 
in many 
cases i 
available 
from other 


sources 
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No specific 
data cited; 


in many 
cases 
available 
from other 
sources 


en 


jReference 


‘Number 


108 


40 


398 


Test Name/ Tasks/or Socio- 
Description Psychological Dimensions 


Test 
Battery 


Maintenance 
tasks 


Simulated 
Space 
Performance 


Crew 
Interaction 


Water 
Immersion 
Simulation 


Underwater 
performance 


mission specific, (3) 


TABLE A-1 (Continued) 


System Performance 
Measures 


structure, space 


(1) psychomotor, (2) Lunar- | Erection of lunar 


walking. 


STRESS: Effect of 


maintenance task 


reduced suit pressurization 


Several sample mission tests 
and performance tests 

(number retention, bi-manual 
matching, and reaction time). 
STRESS: confinement: 15-day 


Crew interaction during 30 


(1) bolt torquing, (2) 
connector mating, (3) 
nut threading. STRESS: 

Effect of lunar gravity 


| 


Performance measures 
for each of tasks 


Measurement made, 
but not reported. 


None 


day simulated space mission 
measured by Bales IPA. 
STRESS: confinement 


for EVA training. 
STRESS: multiple 


Manual dexterity and 
tactual sensitivity 
STRESS: underwater 


compression 


Evaluation of water 
immersion simulation 


Extensive data on 
simulator and actual 
Gemini EVA results 


Validity 


Said to hav 
high face 

validity to 
lunar tasks 


ore 


Said to have 
high face 

validity to 
lunar tasks 


Assumed to 
have high 


face 
validity 
to MORL 


i 


mission 


Not known 


Predictive 
validity 
test 


Test of 
predictive 
validity 


Reliability 


No data 
given 


No data 


No data 
given 


No data 
given; 
available 
from 123 


Insuffieien 
data for 
precise 
analysis 


No data 


the present literature, only two of the test batteries (190, 372) were 
specifically developed based on a task analysis of the human performance 
of interest- using the factor analytic appraoch results. 


If the history of industrial psychology is any guide, precise 
predictions of human performance can only be made based on a thorough 
(microlevel) understanding of the behavior involved. That level of 
understanding does not exist within the man-machine system area. 


2. Upon What Dimensions? 


Adequate measure sets (and the tools by which these are measured) 
must be based on behavioral dimensional analysis. What would be most 
desirable is a thorough analysis of the fundamental behavioral dimensions 
across all man-machine system tasks. Not only is such analysis not 
available, but there is considerable doubt as to how such an analysis 
might be obtained. 


In many areas of human performance studies, however, it is becoming 
apparent that behavioral dimensional analysis and conceptual structuring 
is being attempted despite a lack of sufficient literature and the immense 
theoretical complexities involved. The impetus to this effort seems to 
be a growing awareness that some conceptual framewo: k- no matter how 
tentative or intuitively unsatisfactory- is essentiel if any understanding 
is to be obtained from empirical data.* As Humphrey; (65) points out in 
another context, one needs some sort of conceptual mudel to make sense 
out of the data. 


What this all implies is that some sort of quantitative theoretical 
modelling is unavoidable. While such modelling has been underway for 
some years in the basic psychological and sociological literature, 
investigators in man-machine system problems have generally avoided this 
avenue with the exception of certain particular areas such as human 
tracking performance and decision making. Recently, Teichner and Olson 
(76) have made a major attempt to accomplish this type of modelling for 
predicting human performance in space environments. Their objectives 
are worth quoting: 

"....it is our purpose to develop an admittedly 
tentative theoretical framework to represent the depen- 
dence of human performance upon the physiological 
processes which intervene between the environmental input 
to the human and measures of his performance. We shall 
use available concepts and theories as best we can, but 


* And to give us some indication of what kinds of data we should be 
collecting. 


we shall not feel bound by them. Such an approach has 
at least heuristic value; it serves a working logic, 
though imperfect, to be improved upon, or replaced as 
evidence is gathered. It may lead to a more rigorous 
framework, albeit a different one. It should also serve 
as a basis for determining the major requirements of 
systematic research both to improve the concepts as such 
and to increase their power in predicting environmental 
effects." 


It is to be expected that much more of this kind of work will be (or 
should be) appearing in the man-machine systems literature. 


With the increased use of multiple test batteries and hence several 
behavioral dimensions, it is probably inevitable that some attempt should 
be made to relate these dimensions to the criterion variables. This 
situation suggests immediately the use of multiple regression and/or 
canonical correlation quantitative frameworks. Helmreich (263), for 
example, was able to achieve some success with multiple regression 
predictions in the SHALAB IT results. 


Finally, it may be noted that the complete lack of measurement 
standardization in man-machine systems is certainly not due to a lack 
of measures (cf., 31, 41, 123, 502) but rather to a lack of standarized 
dimensions which would specify what should be measured. The present 
measurement approach in man-machine systems problems appears to be one 
of measuring what is convenient in lieu of measures that have behavioral 
or system performance meaning. 


3. With What Tools? 


There is a very widely held feeling among many human factors 
specialists that human performance prediction is man-machine systems can 
only be accomplished by actual tests on the operational equipment or by 
high face validity simulation. With the present state of our prediction 
tools, this is probably a very reasonable point of view. However, there 
are some rather serious problems with this approach. 


Prediction tests accomplished on high face validity simulation 
assumes that there is sufficient knowledge about the system so that 
fidelity of simulation can be achieved. But, by the time the system 
has reached that point the design need for human performance prediction 
has disappeared. Tests, at this point, become either the verification 
or rejection of predictions already long since made. 


Second, one simulation approach is to test techniques within a sort 
of generalized application setting assuming that the results will apply 
to later, specific, applications (cr., 408, 409, 411). ‘There is no 


te 


evidence that this assumption is in fact valid, and there is some 
evidence in the case of manned booster guidance and control that the 
assumption was false (41). 


Third, there is a small but substantial literature (cf., 30, LOY, 
388) that specifically shows cases where simulation results did not 
predict operational performance despite what appeared to be high face 
validity. And, in some cases, simulation techniques may be quite dif- 
ferent from operational techniques in order to achieve performance 
predictions and training (cf., 405). 


There is, in fact, justification for the point of view that suggests 
that all of our tools- from simple laboratory tasks to the most complete 
of simulations- are suspect (at least to varying degrees) as to their 
predictions of human performance. As a case in point, one might note 


the area of vigilance research. Over the past 15 years, a very substantial 


human factors literature has been created on vigilance. But what is the 
relevance of this research for operational performance? Kibler (40h) 
suggests that a shift in the nature of actual monitoring tasks has 
resulted in the possibility that "...the results of classical vigilance 
research may not be particularly germane to contemporary monitoring 
problems." One wonders how many other areas in human factors show the 
same result. 


4, For What Purposes? 


Finally, there would appear to be much confusion in the Literature 
as to the specific purpose for which tests are used. In general, there 
would appear to be a hope that a small test sample will lead to precise 
quantitative predictions of human performance. Further, as noted, there 
appears to be an implicit interest in some cases in human behavior alone. 
And, a good share of the test literature now available is specifically 
intended for selection and placement. 


In some cases it is difficult to escape the conclusion that the 
test or test performance panel was developed to meet some specific 
operational setting (airborne or ground simulation) and very limiting 
engineering requirements at the expense of behavioral meaning, validity, 
reliability, and usefulness. In these cases, what has resulted is 
small, compact and efficient devices which produce data with no apparent 
human performance prediction meaning. 


It would be most desirable if future investigators would consider 
very closely the nature of the information desired by their test tools. 
Selection, placement, classification or training objectives imply quite 
different configurations of tests. 


LO 


A Generalized Methodological Model 


In the review of the test literature conducted in this program, 
there was a substantial suspicion that the major difficulty existed not 
in the tests per se but in the methodological framework within which the 
tests were conceived and used. A simple enumeration of the existing 
tests led to no particularly useful result, and, in fact,. simply 
demonstrated that a rather chaotic situation existed (cf., Table A-1). 


For clarification, a generalized methodological model was developed 
within which (1) the current test literature could be categorized and 
(2) some rules could be indicated by which future test programs for 
human performance prediction could be developed. The generalized model 
is shown in Figure A-l. 


What the figure says in effect is that for human performance pre- 
diction in man-machine systems we must be concerned with three levels of 
measurement analysis: (1) system requirements and appropriate system 
performance measurement, (2) human operator task analysis and the per- 
formance measures related to that level, and (3) basic behavioral 
dimensions involved in human task performance. Further, the precise 
interrelationships between these levels should be quantified. No 
attempt was made (nor is it presently possible) to accomplish an 
integration of the man-machine system and test Literature within this 
model. Rather, it was hoped (1) to indicate where major problems exist 
and what solutions are presently available, (2) to provide a framework 
for the current test literature, (3) to indicate where specific lines of 
future research may be particularly useful, and (4) frankly to attempt 
to stem the current tide of isolated test development and random 
empiricism. 


1. Despite the existence of many methods for human operator task 
analysis, there still exists serious problems in this level of analysis. 
In Chapter B, the problem of task taxonomies is examined, and a specific 
taxonomy was developed for use in a selected set of manned space flight 
system tasks. It may be noted parenthetically that a major long-range 
research program is currently underway by Fleishman and his associates 
(9) to develop an integration model between task dimension analysis and 
behavioral dimension analysis. 


2. Much of the test literature is in terms of basic socio- 
psychological dimensions. In Chapter C, a 75-dimension structure is used 
for the classification of existing tests (see also Volume II for the 
complete test catalog.) At the present time, it is very difficult to 
relate these dimensions to applied human operator task performance. 
However, if such a mapping bridge can be made a very substantial amount 
of existing test literature is available. 
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FIGURE A-1. A generalized methodological model for the 
evaluation and development of human performance 
prediction tests. 


System 
Performance 
Measures 


3. The problem of personality variables and stress responses is 
examined in Chapter D while the problem of group performance dimensional 
analysis is reviewed in Chapter E. In both cases, we are dealing with 
a very large yet very confusing literature. 


h, The problem of a necessary and sufficient set of performance 
dimensions is explored partially with respect to behavioral dimensions 
in the framework of multiple regression equations in Chapter C. There is 
some suspicion that this space is not particularly appropriate to the 
complexity of human operator performance; there is no doubt, however, 
that the data is insufficient to make other than tentative approaches 
to conceptual structuring. 


5. The derivation of system performance measures, and the relation 
of these measures to task performance and behavioral performance measures, 
is discussed at length in Chapter F. The full complexity of the total 
prediction problem becomes apparent at that point. 


le 


For over three decades a very substantial test literature has 
evolved. on human performance testing in the general man-machine system 
eontext. This literature to date, however, is structured and conceptually 
fragmented. It would appear that the difficult steps to achieve our 


prediction goals are yet to come. 
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CHAPTER B: TASK AND FUNCTION ANALYSIS 


To Predict What? 


As has been discussed in Chapter A, the initial starting point in the 
problem of human performance prediction in man-machine systems must be a 
precise understanding of the behavior one is trying to predict. This step, 
however, turns out to be one of major difficulty due to a lack of stand- 
ardization of behavioral description. By inference from the literature one 
might conclude that we are attempting to predict: individual behavior 
within the context of some task, or individual behavior as if task- 
unrelated, or system performance measures in which individual human 
behavior plays an unspecified part, or some combination of all three. In 
fact, ultimately we would wish to predict both individual behavior and 
system performance and in a way that would quantitatively indicate the 
relation between both. ‘The present state of the literature clearly shows 
we are a long way from this objective. 


In line with the point of view of the present program it was necessary 
to select some approach to the specification of task and system behavior 
to which the test literature could be related. What would have been most 
desirable would have been to have available an analysis of all man-machine 
system tasks. Such, of course, is not to be found in the literature. 
Indeed, it is interesting to note that there has apparently never been a 
thorough attempt to classify the types of behavior that are to be found 
in this specialized domain called "man-machine system tasks.” 


To provide a behavioral setting, it was decided to take a specific 
applied setting which illustrates behavior of interest to the NASA and 
which provided a sufficiently wide range of behavior from which we could 
draw examples illustrating major prediction problems. As will be dis- 
cussed in a later section of this Chapter, the setting was an extended, 
multi-crew, earth orbital mission. 


However, a fundamental problem exists in the method by which human 
behavior in this, or any other man-machine system, is described. This 
inevitably requires some consideration of man-machine system task 
taxonomy- in short, the way by which human behavior is classified within 
man-machine systems. Many methods of task analysis exist within the 
literature (cf. 1-29, 32), but a very thorough review of these methods 
failed to reveal any particular method of direct usefulness, showed the 
lack of standardization in the field, and suggested that a new attempt at 
a basic taxonomy was in order. 


The Meister Taxonomy 


Accordingly, Dr. David Meister, of the technical team, developed an 
extensive technique of task analysis to be used for the system context of 
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human behavior in the hypothetical Extended Earth Orbital Scientific 
Laboratory. Beyond that, it is an attempt to derive a general task 
taxonomic method. 


Four taxonomies are presented in this approach, three of which 
represent different levels of description of operator behavior (Personnel 
Behavior Taxonomy- Descriptive Levels 1, 2 and 3), whereas the fourth 
represents the dimensions of the task the operator must perform (Task 
Dimensional Taxonomy). A number of points should be made concerning these 
taxonomies: 


1. ‘The purpose of using these taxonomies is to derive a set of 
specifications for tests to measure the various behavioral functions to 
be performed operationally. The task dimensions describing these functions 
in essence spell out the characteristics which the tests must have in order 
to predict the performance of personnel performing these functions. For 
example: Assume that the function is scientific experimentation, subfunc- 
tion biological, and that as an end product of the analysis it has been 
determined that the following task dimensions describe that experimenta- 
tion: directly viewed stimuli of a qualitative nature with a long duration, 
involving only one man. The responses required are primarily mediational 
(analytic) with some fine precision motor responses also required. Accuracy 
and time requirements are high, but there are no environmental stresses. 
Feedback is direct, consisting of measured quantitative values. There is 
no time sharing and consequences of incorrect performance (to vehicle 
integrity and personnel safety) are nil. Task instructions are unwritten. 


On the basis of such specifications for each function, it should be 
possible to build new tests or select already existent ones on the basis 
of their conformity to these requirements. We are therefore not concerned 
with a description of behavior per se except insofar as it permits us to 
extract those dimensions of the task which produce that behavior. 


2. The goal of the investigator will determine the particular 
taxonomy he develops or accepts. Although most researchers in the field 
have talked as if they wanted a taxonomy of task behavior (i.e., a taxonomy 
describing the tasks presented to personnel), -hence the term "task" 
analysis--in reality they have been looking for a taxonomy describing not 
tasks but the behavior elicited by those tasks. The result is that the 
task analysis has been Largely ineffective in influencing the design of 
equipment of training programs. 


Others have been preoccupied with developing a taxonomy of abilities 
underlying behavior. Consequently, their taxonomies have not described 
behavior in the sense in which one views an overt act, but rather have 
attempted to describe the parameters underlying that behavior. It is one 
thing to describe a man reaching for a switch; it is another to describe 
that act in terms of control precision, extent flexibility, etc. 
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It is not that any one taxonomic method is superior to another, or 
that universal truth is contained in one taxonomy and universal error in 
another, It is a fact that despite all pretensions to the contrary, no 
taxonomy has inherent truth in it. A taxonomy is a convention on which ail 
concerned will agree as representing an acceptable way of denoting things. 


Although they would deny it if it were called to their attention, 
previous workers have talked of a taxonomy as if there were only one; and 
if that one were developed, it would solve all their problems. This is 
unacceptable. There are simply a number of possible taxonomies for 
different purposes, leading to different consequences and outputs. Above 
all, the value of a taxonomy lies in what it permits one to do with the 
taxonomic outputs. 


3. It is apparent that a number of taxonomies can be developed. The 
following can be identified: 


(a) A taxonomy of personnel behavior or a behavioral taxonomy. 
Such a taxonomy aims to classify what the operator or the pilot or the 
maintenance man does or has to do in a given task situation. Such a 
taxonomy is phrased in terms of subjects' responses to task stimuli, 
e.g., lifts weight, reads meter, plugs in component. 


Subclasses of the behavioral taxonomy include: 


(1) Descriptive behavioral taxonomy. Such a taxonomy 


describes literally what the man does, e.g., steers aircraft, tracks 
target. Presumably, in its pure form, uncontaminated with other taxonomic 
variables, it makes no judgments concerning what cannot be overtly seen or 
described in explicit operations. 


(2) Analytical behavioral taxonomy. In contrast to pure 


description of overt behaviors, this type of taxonomy attempts to classify 
the underlying mechanisms responsible for the overt behavior. Categories 
such as short-term memory, decision-making, coding, monitoring, etc. 
represent the analytic taxonomy. The goal is to penetrate to causal 
factors. Consequently, the taxonomy deals not with immediate behaviors 
but with intervening (possibly causal) mechanisms. 


A major use has been made of this approach in the 
analysis of behavioral dimensions for individual and group behavior 
(see Chapters C and E) and as a method for stress analysis (see Chapter D). 
Most of the pertinent test literature has relevance only to such a 
taxonomy. 


(b) In contrast to a behavioral taxonomy it is possible to 
develop a true task taxonomy, that is, literally a taxonomy which describes 
the dimensions of the task being presented to the operator and its 
environmental context. Here we are concerned not with what the man does in 
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responding to the task, but what the task consists of. Although the task 
dimensions differ markedly from those used in the behavioral taxonomy, 
there is a direct relationship between the behavioral and task taxonomies, 
such that one is (or should be) readily interpretable in the other's 
terms o 


4, Every taxonomy implies a method of analysis. ‘This has not 
generally been realized. If one's taxonomy involves a very detailed 
description of personnel behavior, then the analytic method requires a 
very detailed breakdown to the subtask or individual stimulus-response 
combination. 


5. The method implied by the concepts described in this paper 
involve a two stage form of analysis, as follows: 


(a) Analyze the behavior required of personnel down to the 
task (but not to the subtask or element) level. 


(b) Analyze the task which elicits that behavior in terms of 
four categories: 


(1) Initiating stimulus (stimulus which requires perfor- 
mance of the tasks, e.g., communication from radio). 


(2) Response requirements (action which must be taken in 
response to initiating stimulus, e.g., record instructions). 


(3) Feedback (event which indicates that the response 
has been performed, e.g., base sign off). 


(4) Task context, other factors impinging upon performance 
of the task. 


With regard to the size of the behavioral unit to be described, it is 
not considered necessary to extract every molecular stimulus-response 
combination unless that combination is distinctly different from the others 
in the task of which it forms a part. For example, take the behavior 
unit, "track moving target on display." Obviously, this unit is composed 
of many individual behaviors, each of which has a discrete stimulus and 
response. However, we need not analyze down to the individual muscular 
action unless that action (in and of itself) is crucial to the performance 
of the task/function. Another example: in checkout, many switches may 
be thrown. It is not necessary to identify each switch and perform an 
analysis of each switch activation. It is sufficient to analyze down to 
the point of saying, "sequentially throw switches." 


Under the three main headings, initiating stimulus, response require- 


ments, and feedback, the categories listed in the task dimensional 
taxonomy will be applied. In effect these categories are questions about 
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the initiating stimulus, required response and feedback which, when 
answered, describe the characteristics of task performed. In addition, 
a fourth colum headed "Task Context" will be completed. Wherever 
possible, quantitative, specific statements should be made about these 
categories. 


After the function has been analyzed in this way, the task dimensions 
which characterize that function will be summarized. This can be done by 
listing for each function the different qualitative dimensions with their 
frequency of occurrence; and, where the dimensions are quantitative, 
describing their mean and range. 


Task dimensions for different functions can be compared to determine 
commonality among these functions and to extract task dimensional com- 
plexes which would require distinct tests. For example, one might find 
one complex of dimensions which were largely qualitative and analytic, 
while another might be largely perceptually oriented. These would each 
require individual tests. 


On the following pages, the following taxonomic procedures are 
presented: 


PERSONNEL BEHAVIOR TAXONOMY: DESCRIPTIVE LEVEL 1- Functions 
PERSONNEL BEHAVIOR TAXONOMY: DESCRIPTIVE LEVEL 2- Tasks 


PERSONNEL BEHAVIOR TAXONOMY: DESCRIPTIVE LEVEL 3- Behavioral 
Elements 


TASK DIMENSIONAL TAXONOMY 


They are presented in procedural form to indicate the exact items and 
steps by which the taxonomies are applied. Specific applications may be 
seen in Appendix B. 


Personnel Behavior Taxonomy: Descriptive Level 1- Functions 


The functions referred to do not necessarily describe segments of 
the manned space mission. (In fact, most of them don't). The initial 
functions (i.e., preparatory operations, equipment/status checkout, 
initiation of operations) could follow the sequence in which the mission, 
is presumed to start, but could also be applied at any time during the 
mission, as do the other functions. In determining which function the 
task behavior implements, it is necessary to ask: What is the purpose of 
these behaviors? An individual task can have but one function: 


(1) Preparatory operations 


(a) Task planning--involves no motor activity except possibly 
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writing (data). May occur at any time during the mission, for example, at 
the start of an experiment recording. No precise perceptual activity 
except reading written material. May involvé communication and computa- 
tion. Probably will involve decision-making and data analysis. 


(b) Equipment set up/warmup--This function is quite distinct 
from task planning in that it may be highly loaded on motor (manipulative) 
activity. It may, in fact, occur at any time during the mission (e.g, 
setting up equipment for scientific experimentation). It refers to the 
initial activation of an equipment where that equipment requires warmup or 
initial adjustment before it becomes functional. Equipment set up may 
involve connection or adjustment of equipment (s) before the purpose of 
the equipment can be accomplished. 


(2) Equipment/system status checkout 


(a) Pre-task check-performed prior to initiating operations. 
Visual inspection of displays (e.g., meters) together with some discrete 
activation of controls to place them in proper position prior to initiating 
an operation. May involve reading from checklist. 


(b) Intra-task check-check performed during the performance of a 
job. Differs from pre-task check because it is accomplished during rather 
than at start of job. May involve display monitoring of subsystem status 
and communications. It is possible that data will be recorded and analyzed 
and some decision making will be involved. Differs from navigation in the 
sense that it is relatively discrete, whereas navigation involves continu- 
ous perceptual motor coordination. 


(3) Initiation of operations 


(a) Equipment activation--Involves turning an equipment on to 
perform its programmed function. In terms of mission sequence this func- 
tion differs from vehicle activation in the sense that equipment activa- 
tion may occur at any time during the mission, particularly with reference 
to scientific experimentation, activating life support equipment, etc. 


(b) Vehicle activation--Essentially equivalent to takeoff. 
Involves performance of control-display operations, communication, tracking, 
etc. Is distinguished from navigation in the sense that vehicle 
activation refers to a rather discrete mission segment, whereas navigation 
may cut across several mission segments. Differs from equipment navigation 
in that equipment activation refers to the single equipment; vehicle 
activation refers to the total vehicle system. 


(4) Navigation 


(a) Course following--Essentially a perceptual-motor activity 
of a continuous nature (e.g., activating controls in response to or in 
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accordance with display indications or tracking). Essentially means 
following a preset course when the course has been set in the mission 
planning function. Like flying an aircraft. 


(b) Course correction--Involves major changes in course as 
opposed to minor corrections which would ordinarily be considered part of 
course following. Essentially discrete activity, but may also involve 
the same perceptual motor activity found in course following. Decision- 
making may be involved as a preparatory stage to course correction. 


(c) Orbital establishment--Will involve the same perceptual- 
motor activity as course following, but specifically for establishing an 
orbit. In addition, may involve computations, as in using a computer, 
and decision-making. 


(a) Rendezvous--Involves the same perceptual-motor activity as 
course following, and the same computational and decision-making as in 
establishing an orbit, but specifically for rendezvous. Tracking will be 
a major functional component. 


(e) Docking--Same as rendezvous, but specifically for docking. 


(5) Subsystem management 


This function involves monitoring and control of specific vehicle 
subsystems as distinguished from overall vehicle navigation. May involve 
display monitoring, communication, data recording and analysis, decision- 
making, etc. Probably will not involve continuous perceptual motor 
activity. 


(6) Scientific experimentation 


This function may be performed at any time during the mission 
except vehicle departure or re-entry. All task behaviors with the exception 
of trouble-shooting may be involved. 


(7) Installation/assembly 


This function involves motor activities primarily (e.g., precise 
control manipulations); but may also include communication, inspection of 
equipment, decision-making, movement of equipment, opening/closing hatches. 
Monitoring, tracking and control-display operations, data recording, 
computation and analysis would almost never be involved. Assembly might 
tangentially overlap with experimentation as an initial phase, but rarely. 


(8) Maintenance 


(a) Programmed maintenance--this function would involve cleaning 
and calibration, as well as check of equipment functioning. Because of the 


latter there is some possibility of overlap with equipment/system status 
checkout, although it would be preferable to restrict equipment checkout 
to equipments involved in inflight, ongoing vehicle navigation and guidance 
operations; and confine programmed maintenance to equipment not involved 
in these operations. Programmed maintenance would not ordinarily be 
performed on equipments while they are functioning. 


(b) Unprogrammed maintenance (malfunction diagnosis and repair)-- 
This function is a contingent one (ices, may, but need not necessarily 
occur). This function should be assigned only when it is assumed that an 
equipment has malfunctioned. It may involve any of the following task 
activities; data recording and analysis, communicating, visually 
inspecting equipment, decision-making, and precise control manipulations 
(the last for repair). 


(9) Emergency responses 


This is another contingency function which may involve any of the 
task descriptors noted, except those involving maintenance and general 
housekeeping. Specifically excluded from emergency responses is equipment 
malfunction except where the malfunction has further effects such as 
endangering vehicle operation or life support of personnel. 


(10) Communication 


This function is relatively obvious. However, it may present 
certain problems because communication is involved in many other functions. 
The communication function noted here refers to an activity in which the 
prime function is communication; communication which is ancillary or which 
implements another function should be covered by the other function. 


Personnel Behavior Taxonomy: Descriptive Level 2- Tasks* 
(1) Perform control-display operations 


(a) Activate controls in response to or in accordance with 
display indications 


routine programmed procedures (e.g., checkout) ; 
routine variable events Ce.ge; course corrections) ; 
emergency situations. 


lop role 


Indicate whether discrete perceptual-motor coordination or 
continuous . 


(These behaviors will involve, but not be completely 
restricted to, continuous perceptual-motor activity of the type found in 


* The only tasks considered are those required by the mission, thus 
excluding general housekeeping functions. 
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vehicle navigation and operation. This function should also describe 
checkout activities when the checkout involves navigation and guidance 
operations but not preventive maintenance. Otherwise the preventive 
maintenance descriptor should be applied. A distinction should be drawn 
between routine and emergency events, although the behavior itself might 
be the same.) 


(b) Activate controls (no prior display indications) 


(Apply this category only when there is no reference to 
display indications, Otherwise apply (la). This kind of behavior (e.g., 
calibration) in which there are not display indications, is likely to 
be somewhat infrequent. 


(c) Monitor display indications (no control activation required) 


1 Note change in status indications and compare displayed 
values with required system values. Indicate whether monitoring is 
prolonged or comparatively short. 

(Monitoring implies apparently continuous perceptual 
activity. Also implies coordination of data from multiple display 
sources. Control actions may be completely lacking, or, if present, are 
so infrequent as to be neglible. For example, one might monitor a TV 
screen and make only those infrequent focusing adjustments needed to 
maintain the picture. Display monitoring is distinguished from tracking 
because the displays being monitored describe individual subsystem status, 
whereas tracking involves a moving target.) 


C2) Tracking - determination of position of own and/or target vehicle. 
(a) visual tracking only; 
(b) visual tracking plus position plotting (recording). 

(As indicated in connection with (1c), tracking involves 
geographic position only and not subsystem status monitoring. Position 
plotting refers to recording the vehicle track.) 

(3) Record data received 
(a) from displays 
(b) from personnel 


In the latter case indicate whether by intercom or face 
to face. 


(Data recording may be incidental to a more significant 
task behavior, e.g., subsystem status monitoring. Therefore, this 
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category should be applied only if the recording function is explicitly 
called out in the task description.) 


(4) Communicate 
(a) instructions and commands 
(b) information 
Indicate whether via radio, intercom or face to face. 


(As in the case of data recording, this behavior may be 
incidental to a more significant task. This category should be applied 
only if the communication function is explicitly called out as a 
specific task. In many cases, it may be impossible to differentiate 
between instructions and information; in this event, ignore the 
subcategories.) 


(5) Directly or by means of telescopic lens observe external vehicle 
events (e.g., as in observing star positions through porthole). 


(This behavior is differentiated from display monitoring in the 
sense that with the exception of magnifying devices, no mechanisms are 
used to display the external event to the crew member.) 


(6) Perform quantitative computations 


(a) measure quantity 
(b) calculate numerical values 


(Two behaviors must be differentiated: (a) in an experiment, 
to perform some measurement behavior, such as measuring magnetic force 
through the adjustment of an equipment--the equipment manipulations, 
unless extensive, would not be the major behavior; (p) to calculate 
numerical values as in adding up a column of numbers. (b) may follow 
(a), or may be independent of (a)). 


(7) Perform preventative maintenance 


(a) visually inspect equipment 


(b) perform equipment checkout in accordance with routine 
programmed procedures 


(c) clean, lubricate or otherwise perform gross equipment 
adjustments « 


(Visual inspection of equipment involves no control adjustment 
and does not involve reading subsystem displays. It must be differentiated 
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from equipment checkout because checkout implies control manipulation. 
Equipment checkout must be differentiated from control-display activation 
(item 1) because checkout is specifically directed at maintenance. 
Cleaning, lubrication, etc. involves gross motor actions in relation to 
an equipment being maintained. Each of these sub-categories should be 
applied only if the task description specifically calls out the behavior 
being applied. Where more than one behavior is involved in the task, 

the category of prime significance should be applied.) 


(8) Make decisions 


(a) Decide between two or more 


1 hypotheses (e.g., concerning meaning of scientific 
phenomena.) 

2 discrete alternatives (e.g., modes of operating - 
equipment) 


3 general strategies 


(b) Analyze alternatives (e.g., different ways of troubleshooting 
an equipment) 


(c) Analyze data 
(a) Anticipate/predict events 


(e) Hypothesize causal relationships (e.g., that two events 
are related) 


(f) Verify that an hypothesis is correct by reference to available 
data 


(g) Troubleshoot malfunctioning equipment 


In each case note whether the decision process was 
accomplished in relation to (1) programmed mission events; (2) 
unprogrammed mission events. 


(The characteristic which differentiates decision-making from 
other categories is the amount of cognitive activity of a complex nature 
involved, and this must be explicitly called out in the task description. 
Cognition is involved in all behavior; but only conscious efforts at 
problem solution can involve decision-making. ) 


Hypotheses describe conjectures about possible contingencies. 


Discrete alternatives refer to programmed alternatives for 
operation, as, two recommended ways of accomplishing docking. 


ok 


General strategies refer to a series of hypotheses or 
alternatives extended in time. 


Analysis of alternative strategies involves comparison of 
two or more general strategies. 


To anticipate/predict events is to deduce consequences from 
one or more preliminary events. 


To hypothesize causal relationships is to suggest that event 
A and event B (or a series of events) are related on the basis of some 
common class characteristic or projected consequence. 


To verify hypotheses is to deduce that certain data are in 
accordance with a particular hypothesis. 


Troubleshooting is self-explanatory.) 


Note: Unless the task description is specific enough to sub- 
categorize the decision-making behavior, the analyst should 
simply note the behavior as being decision-making, with a 
further note that it could be one or more of the subcate- 
gories. In other words, the subcategories are to be used if 
the analyst has in fact sufficient data to make a valid 
conclusion about the subcategory. 


(10) Put_on/remove personal equipment 


(No comments necessary. Self explanatory.) 


(11) Open/close doors, hatches, access covers, etc. 


(No comments necessary. Self explanatory.) 
(12) Move from one vehicle location to another 
(a) self locomotion 
(b) transport equipment 
(Again this category is self explanatory.) 
(13) Read written material 
(It is necessary to differentiate reading from (1) monitoring of 
displays and (2) analysis of data. ‘The reading of written material does 
not involve displays of any sort; it does not require data analysis in 
the sense of problem solving or decision making. If one crewman reads 4 
checklist to another during an equipment checkout, to guide the checkout, 


this is reading. Again, this category should be applied only if the task 
description specifically calls it out as an activity.) 
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(14) Precise control manipulations 
(a) connect and adjust equipment 
(b) remove/replace equipment components 
(Subcategory (a) refers to equipment set up for experimentation 
or equipment calibration; subcategory (b) refers to troubleshooting 
activities, or at least the removal and replacement of components as part 
of the troubleshooting process. The kind of manipulations involved are 


quite precise, not just flipping switches, but such things as connecting 
or disconnecting wires, inserting jacks, removing tubes, etc.) 


Personnel Behavior Taxonomy: Descriptive Level 3- Behavioral Elements 

Motor Responses 

(1) Depress single control 

(2) Turn single rotary control 

(3) Adjust control to specified value 

(4) Activate bank of controls (in series or all at one time) 
(5) Type message on keyboard 

(6) Insert object (e.g., component, test probe) 

(7) Remove object (e.g., component, test probe) 

(8) Lift object 

(9) Move object 
(10) Place object 
(11) Open/close door, hatch, access plate 
(12) Connect/disconnect (e.g., equipment, wire) 
(13) Write 

Perceptual-Motor Responses 

(1) Align control in accordance with display 


(2) Adjust display using controls (e.g., focus, change range) 
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(3) Detect target or other unanticipated object 
(4%) Monitor display 

(5) Observe external vehicle events 
(6) Inspect component/equipment 

(7) Discriminate two or more stimuli 
(8) Identify object 

(9) Locate object 

Mediational Responses 

(1) Measure quantity 

(2) Calculate values 

€3) Compare values 


(4) Analyze alternatives (e.g., different ways of troubleshooting, 
different courses) 


(5) Decide between alternatives (e.g, modes of operation) 
(6) Anticipate/predict events 

(7) Hypothesize that events are related 

(8) Verify correctness of hypothesis by reference to available data 
(9) Analyze data/information 
(10) Extrapolate plot of moving target 

Communication Responses 

(1) Communicate instructions/information 

(2) Ask for information 

(3) Listen to radio/intercom 

(4) Answer communication 


(5) Request permission 
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Task Dimensional Taxonomy 


Analyze the task to the extent permitted by available information in 
terms of the following categories: 


Ae INITIATING STIMULUS 
1. Type 
Be Visual 
b. Auditory 
Co Kinesthetic 
2. Mechanism 
Bo Directly viewed event 
b. Display (indicate type) 
e. Written material 
3, Characteristics 
Be Alphanumerics 
be Raw stimuli (e.g., radar pip) 
ec. Coded stimuli (e.g., geometric forms) 
de Changing or moving stimulus 
ee Static stimulus 
f. Multiple characteristics (e.g., visual plus auditory) 
4, Information Presented 
a. Quantitative (specify value) 
De Qualitative 
e. Content (specify) 
5. Duration 
ae . Persistent (indicate approximate duration) 


b. Short-lived (indicate approximate duration) 
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Number 
ae Single 


De Multiple (indicate number, as, number of indicators, 
number of pips) 


B. RESPONSE REQUIREMENTS 


1. 


Be Perceptual 
detection/recognition/discrimination (indicate one) 
Do Motor 


discrete activation/continuous adjustment/gross 
physical (lifting, moving, etc.) (Indicate one) 


Ce Perceptual-motor 
d. Mediational 
decision-making/computational/analytic (indicate one) 

e. Combined (specify) 

Content 

Be Specify nature of response to be made in terms of 
(1) goal to be achieved 
(2) means by which response is performed 

Number 

a. Discrete/individual 

De Serial/multiple 

Co Repetitive 

Accuracy Requirements 

@e  High/low (specify quantitatively, if possible) 


De Indicate nature of accuracy requirements 


5o Time Requirements 


Bo Indicate if time requirement (time in which response must 
be performed) exists; if so, specify time 


Dd. Indicate how long response must be maintained. 
6. Stress Factors 


Be Indicate if response must be made under physically stressful 
conditions 


lon Describe nature of stressor 


FEEDBACK 
1. Criterion of Correct Performance 
a. Quantitative (specify) 
be Qualitative 
2. Modality (how feedback is presented) 
Be Direct 
(1) visual display indicator(s) 


single 
multiple 


(2) auditory 
(3) other 
be Indirect 
3. Content 


Be Describe nature of information presented when subject 
completes response; or 


be Describe how subject determines correctness of his response 
4, Duration 


Indicate duration in which feedback indications will persist 
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De. 


TASK CONTEXT 


1. 


Number of personnel (required for task performance) 
Be one 

b. two 

Co three 

d. more than three 


Embedding 


Be Indicate whether response is part of overall procedure; 
or 


Be Discrete 

Task Structuring 

Be Task performed according to routine, specified instructions 
(1) Written 
(2) Unwritten 

De No specified instructions available for task performance 


Failure Consequences 


Indicate consequences if task is not performed correctly (to be 
used in weighing task importance) 


ae Danger to vehicle/crew 

de Possible mission abort 

Co Possible delay in mission accomplishment 
de Task failure only 


Time-sharing 


Describe any ancillary task which must be performed concurrently 
with the one being described. 
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The Meister Taxonomy: A Final Note 


These, then, are the taxonomic methods developed for the analysis of 
the manned space flight behavior selected in this program. Specific 
examples of applications are given in Appendix B. Further, a preliminary 
rating test is given of this taxonomy relative to those of Alluisi and 
Milier in Appendix C. ‘The Meister taxonomy is the most detailed method 
known to us. Some (e.g., 16) would object that it is far too detailed; 
however, considering the complexity of most man-machine system behavior, 
it is difficult to see how any less complex a taxonomy would be 
satisfactory. However, as noted before, it depends upon the use to which 
one is going to put the taxonomy. 


The Mission Analysis 
Specification of Mission Parameters 


The mission chosen for analysis is a hypothetical* Extended Earth 
Orbital Scientific Laboratory. After examination of the various proposed 
laboratory missions and the orbital data associated with each*, it was 
decided that the mission under study would have the following parameters: 


Duration: 180 days 
Orbit: Circular 
Altitude: 307 miles 
Orbit time: 96 minutes 
Crew size: e-5 man 


Duty duration: 3 months 
The orbital laboratory is placed in earth orbit prior to the launch of 
the initial three man crew. This laboratory consists of two sections, 
and it is the responsibility of the initial crew to rendezvous, dock, 
and mate the two sections, and then enter the laboratory and prepare it 
for the scientific experiments that will follow. 

Obviously, this mission constitutes a very large sample of task 
behavior. From that sample, four functions were selected for further 
analysis: 

(1) Rendezvous and docking 
(2) Extravehicular activity (EVA) 
(3) EVA experiments 
(4) Onboard experiments 
*A very extensive survey was made of the literature from which to construct 


the hypothetical mission and the four functions. Annotated citations of 
this literature may be found in Volume III (Refs. 419-486). 
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This choice was made so that a wide representation was possible of quite 
different human operator(s) tasks. 


The performance of the onboard experiments was of particular interest 
both with respect to actual experiments that human observers might make 
as well as to the task analytic structure of human behavior in executing 
those experiments. 


A detailed examination was made of the 49 experiments listed in 
Table B-1 in order to determine a representative sample of activities to 
be studied in detail. From this list, it was decided that five categories 
of experiments could be distinguished. They are: 


A. Astrophysical Studies 
(1) Spectral observations 
(a) Solar surface radiation 
(b) Solar flare radiation 
(c) Space density 
(ad) Planetary atmospheres 
(e) Stellar atmosphere 
(f) Hot star temperature 
(2) Radiation 
(3) Meteorites 
(4) Cosmic radiation 
B. Geophysics 
(1) Magnetic fields 
(2) Energy flux 
(3) Atmosphere 
(4) Energy 
(5) Auroras 
(6) Meteorological 
Cc. Chemical and Physical 
(1) Cystal growth 
(2) Micropiezo electric characteristics 
(3) Fluid interfaces 
(4) Surface effects 
D. Biological Studies 
(1) Agriculture 
(2) Bacteriological 


(3) Botany 
(4) Genetics 
(5) Zoology 


E. Medical and Human Factors 
(1) Cardiovascular 
(2) Zero gravity effects 
(3) Sleep analysis 
(4) Bone demineralization 
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From this very large set the following experiments were selected’ 
for application at the microlevel task analysis: 


1. Stellar atmospheres: 


specifically it was decided to examine 


experiments in celestial radiometry and space-object radiometry. For 
further analysis of this case, Chapter F and Appendix A should be seen. 


2. Cardiovascular: 


specifically heart rate as determined during 


inflight exercise and work tolerance experiments. 


3. Earth atmosphere studies: 


synoptic terrain photography experiments. 


specifically as conducted in the 


A further analysis of this case 


with respect to system performance measurement may be found in Chapter F. 


TABLE B-1 


Sample of Experiments 


Cardiovascular conditioning 
Inflight exerciser 

Inflight Phonocardiogram 
Bioassays body fluids 

Bone demineralization 
Calcium balance study 
Inflight sleep analysis 

Human otolith function 
Electrostatic charge 

Proton electron spectrometer 
Tri-axis flux-gate magnetometer 
Optical communication 

Lunar UV spectral reflectance 
Beta spectrometer 
Bremsstrahlung spectrometer 
Color patch photography 
Two-color earth's limb photography 
Landmark contract measurement 
Reentry communications 

Manual navigation sightings 
Basic object photography 
Nearby object photography 
Mass determination 

Celestial radiometry 

Star occulation navigation 
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Surface photography 

Space object radiometry 
Radiation in spacecraft 
Simple navigation 
Ton-sensing attitude control 
Astronaut maneuvering unit 
Astronaut visibility 
UHF-VHE polarization 

Night image intensification 
Power tool evaluation 
Zodiacal light photography 
Sea urchin egg growth 

Frog egg growth 

Radiation and zero g on blood 
Synoptic terrain photography 
Synoptic weather photography 
Cloud top spectrometer 
Visual acuity 

Nuclear emulsion 

Agene micrometeorite collection 
Airglow horizon photography 
Micrometeorite collection 
UV astronomical camera 

Ton wake measurement 


Once the specific experiments were determined it was necessary to 
go back into the literature to examine the methods used in conducting 
these tests. This proved to be a somewhat difficult task as very little 
material was available on the detailed performance requirements of crew 
members conducting such experiments. However, detailed microlevel tasks 
analyses were completed, using Meister's Task Dimensional Taxonomy. 


Development of Gross Mission, Operational Sequences and Task Analysis 


It should be noted that, consistent with the approach proposed by 
Meister through the Personnel Behavior Taxonomy, that several steps had 
to be taken before the Task Dimensional Taxonomy could be applied. These 
steps included: 

1. Definition of the system criterion 
2. Development of the initial system functions 


3 Development of gross mission tasks 


4, Determination of the relationships between gross mission 
tasks 


be Determination of system variables, goals and indirect 
relationships 


6.6 Development of operational sequences 

Ts Determination of relationships in the operational sequences 

8. Development of detailed task analysis 
For those experienced in system project task analysis, these steps will 
be familiar ones. However, for those specializing in research and 
development of generalized human tasks, it may come somewhat as a surprise 
to suggest that the same kind of detailed analysis is essential prior to 


experimentation if a meaningful answer is to be derived to the question: 
To Predict What? 
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C. MEASUREMENT: BEHAVIOR DIMENSIONS 


Approaches to the Dimensional Problem 


Essential to the usefulness and validity of human performance 
prediction tests and test batteries is the definition of the quantities 
and dimensions which the tests are selected to predict. Far too fre- 
quently in test development and application the content that the test 
is designed to measure is either not clear or is projected to an 
abstracted quantity derived from a theoretical viewpoint lacking in 
operational definitions to connect the test with the abstracted quantity. 
Indeed, with some psychological tests is seems safe to say that the 
tests measure something, but is is extremely difficult to say just what 
that "something"™ is. 


Further, the general state of conceptualization and ordering of 
psychological dimensions can, at best, be said to be in a very crude 
state. Present-day psychological theory tends to the particular and 
specific. "Complete systems theory" is more characteristic of the 
psychology of the beginning of the century and of some three decades 
ago, and there has been an understandable reaction over the last ten 
years against large-scale conceptualizations. 


Be that as it may, it has appeared essential to this program to 
attempt some theoretical structuring and ordering along some set of 
rational sociopsychological (behavioral) dimensions. The intent has 
been to draw as much as possible from all existing literature, to 
synthesize as wide a range of behavior as possible, to generate a 
structure that is compatible with the existing tests and measurements 
literature, and to provide dimensions that will have meaning with respect 
to man-machine systems tasks. 


The attempt to fulfill these objectives is, to say the least, 
overly ambitious. In effect, this is to attempt to order and structure 
dimensionally all major psychological phenomena or, at a minimum, all 
sociopsychological phenomena that are pertinent to man-machine systems 
tasks. Not lesser in magnitude is the implied requirement of extracting 
order from a very large and very chaotic literature. In many respects 
the range of the possible literature for human performance prediction 
in man-machine systems tasks is all of the psychological data, 
Obviously, that is beyond any reasonable or rational bounds. 


Nevertheless, some attempt at dimensional conceptualization is 


mandatory if test devices and test batteries are to be properly developed 
and utilized. 
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Methodologically, the most serious problem to be encountered is 
the fact that there exists at this time a fundamental disagreement 
within the appropriate psychological disciplines and human factors as 
to the correct approach to this problem. There are, at present, two 
explicitly and diammetrically opposed points of view stemming, on the 
one hand, from the task analytic point of view, and, on the other, from 
differential psychology. ‘This conflict has been increasing steadily, 
and within the past two years several publications on these theoretical 
positions have appeared. Unfortunately, these concepts are presented 
as directly denying the validity of the "other" technique. 


The central issue is the appropriate theoretical approach to con- 
ceptualizing man-machine system behavior. To avoid controversial 
labels, it is perhaps best to name the approaches after the authors who 
have been most vocal in their points of view. The first of these, 
therefore, is termed the "Miller-Alluisi" approach, and the second the 
“"Fleishman-Parker" method. 


The Miller-Alluisi Approach 


In a recent and beautifully written paper, Miller (16) has sim- 
marized thoroughly his position m the correct approach to dimensional 
analysis of man-machine system behavior. Among other points, he 
establishes six criteria for the task taxonomy to be used: 


1. The total number of dimensions should be in the range of 15 to 
20 types of behavior that may be seen as part of human operatore per- 
formance. 


2. The dimensions should allow for discriminations between 
observed operator activity, but they do not have to be mutually 
exclusive. 


3. The set of dimensions can "...be learned and applied by an 
experimental psychologist (or perhaps anybody else) in a few hours." 


(16, p- 69) 


4. The set of dimensions should be such as to allow application 
to training and part-task training. 


5. The set of dimensions should allow prediction of human error. 
6. "The level of detail in analysis should suggest a point beyond 
which predictions from available observation or knowledge is no better 


than random." (16, p. 69) 


Miller proposes accordingly an eight-step (sequential) behavioral 
classification scheme which should fit these six criteria: 


of 


1. Concept of purpose: The operator, on some basis, must learn 
the appropriate stimuli and responses and apply them accordingly. 


2. Scanning function: The operator must actively search for task- 
or self-induced stimuli. 


3. Identification of relevant cues function: From all the 
available stimuli, the operator must identify significant patterns of 
cues and name them. 


4, Interpretation of cues: The operator must assign "meaning" 
to task stimuli. 


5. Short-term memory: The operator must retain all significant 
information during a given task performance. 


6. Long-term memory: ‘The operator must retain extended stimulus- 
response associations over long periods of time. 


7. Decision making and problem solving: The operator must be 


capable of complex techniques, tradeoffs, and rules by which action 
alternatives are selected. 


8. Effector responses: The operator outputs of all forms both 
manual and symbolic. 


Miller's (16, p. 72) own evaluation of this classification scheme 
is worth quoting: 


"As evaluated according to many criteria of scientific elegance, 
this list is a mess. One definition overlaps others. The definitions, 
even in their more extended and refined form, are ambiguous for 
observing activities. They lack handles for quantification. But I 
have emphasized that this list is an invention, not a discovery in 
nature. Its test is in utility, not validity in the sense of physical 
experiments." 


Miller claims "modest professional success" is using this classification 
scheme in task analysis, procedure design, human engineering design, 
training and selection. 


Others, however, have not had the same feeling of success with this 
kind of tool. Some experienced human engineers have found that this 
crude and elementary classification of complex human operator tasks 
provides nothing but a set of unclear and superficial labels to the 
behavior involved.* Further, in complex human behavior in systems 


*Two members of the project team used the results of the present mission 
and task analyses (Chapter B, Appendix B) to apply the Miller, Allusi, 
and Meister taxonomies. The preliminary results are given in Appendix C. 
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the most casual examination of the performance involved suggests, for 
example, that the rubric "effector response" is a rather gross label 
for the incredibly detailed output patterns generated by the human 
operator. Last, these labels hardly contribute to an understanding of 
the known complexities of the human operator "scanning function" in 
multiple-input, poor signal/noise display contexts. 


Miller specifically states that the effectiveness of this scheme 
is a function of the knowledge and skill of the user. To varying degrees, 
of course, this is true of all methods. But, without some set of guide- 
lines of how to use the classification scheme across the wide variety 
of human operator tasks, this is little comfort to the human engineer 
_with a system problem. In effect, this suggests that Miller (16) should 
expand his article title from "Task Taxonomy: Science or Technology?" 
to perhaps "Task Taxonomy: Science or Technology or Art?" And, further, 
it must be an art that can be learned by anyone in a few hours. 


Despite Miller's denial that the utility of his system is measur- 
able, and despite any evidence other than his reported personal experience 
that it is usable, some evaluation of the approach seems allowable. His 
own six criteria may be used: 


1. By what a priori reasons can it be stated that human operator 
behavior can be exhaustively described in 15 to 20 dimensions? Or, for 
that matter, 5, 8, 10, 15 or 2? The rule really appears to say that 
regardless of the apparent complexity of the behavior only a relatively 
few dimensions are needed to adequately describe and accurately define 
it. 


2. By the very nature of the fact that the eight categories are 
vague, overlapping and superficially defined, behavior discriminations 
ean hardly be clearly differentiated. 


3. The criterion of a few hours learning time to use the system is 
an open invitation to the misuse of human factors technical methods. If 
a method can be learned in a few hours, it may not be worth learning. 


4, The classification scheme alone hardly implies any specific 
training procedure. Surely, for example, any training in decision 
making and problem solving will not produce transfer of training to 
any specific human operator decision making task. 


5. These dimensions provide no apparent way of predicting human 
operator errors. These labels do not imply the category in which errors 
will occur, what kinds of errors they will be, or the frequency with 
which they will happen. 
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6. Nothing in these labels implies the level of predictive 
effectiveness - from randomness to perfect predictability. This 
criterion seems to say in effect: "Don't analyze to any more detail 
than you have to." If this is so, agreement can be quickly reached. 


Thus, on the basis of his own utility criteria, Miller's approach 
seems questionable. But, there also appears to be a serious potential 
difficulty in this technique. The method implies (1) that a quite gross 
level of behavioral analysis is not only adequate but desirable and (2) 
that detailed understanding of human operator performance is not 
necessary. The possibility could be raised that this kind of approach 
may well inhibit future understanding of human performance in man- 
machine systems. 


The Alluisi Method. A conceptual approach similar to that of Miller 
has been advanced by Alluisi (49). Based on techniques derived from 
several years to study of operational problems of confinement and work- 
rest cycles (cf. 349, 350, 352, 353), Alluisi has advanced a method 
based strongly on task face validity. Seven basic eategories are used 
which must be assumed to describe the basic behavior categories found 
in operational man-machine system tasks: 


1. Watchkeeping functions: This effectively means monitoring of 
the system process. 


2. Sensory-perceptual functions: This refer to the task of 


identification of signals. 


3- Memory functions: Both short-term and long-term memory are 
included in this category. 


4. Communication functions: All aspects of man-man communication 
are designated here. 


5. Intellectual functions: Information processing, decision making 
and problem solving rest in this category. 


6 Perceptual-motor functions: Any system requiring psychomotor 
activity. 


7. Procedural functions: Involving not the usual meaning of the 
term but rather "...such things as interpersonal coordination, co- 
operation, and organization." (49, p. 379) 


With the necessary assumption that these seven categories encompass 
all significant human operator performance in operational systems, 
Alluisi has devised and tested a multiple-test battery for these specific 
functions. A very substantial quantity of data have been collected 
under excellent experimental conditions with admirable rigor. 


The particular multiple-test battery is of course of direct 
interest here, and has been summarized in Table C-1. It should be 
particularly noted that the simultaneous use of the tests in various 
combinations allows for work load analysis. With the addition of 
physiological measures (e.g., pulse rate and axillary temperature) , 
the multiple-test battery provides 12 measures of performance. 


TABLE C-1 


Specific Tests in the Alluisi Multiple-Test Battery 


FUNCTION 


TEST 


Monitoring of Static Processes 
Ll. Warning-Lights monitoring 
2. Static Lights monitoring 


Monitoring of Dynamic Processes 
1. Probability monitoring 


Visual target-identification task 


Arithmetic computations 


Not currently measured; research in 


Not specifically measured; code-lock 
task being modified for this function 


No specific task or test; develop- 


1. ree 
2. Sensory-perceptual eee 
3. Memory functions 
4. Communications functions 
planning stage 
5. Intellectual functions 
6. Oe ere 
ment in progress 
Te opel sncaattiaas Code-lock solving 
8. "Synthetic work” 


Simultaneous use of various tests 
to introduce variable work load 
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Some theoretical and methodological comments might be made on 
this synthetic task approach: 


1. It is essential that the functions shown in Table C-1 have high 
content validity with respect to actual human operator system _ tasks. It 
would appear that these categories could probably be identified -in many 
actual system tasks. Sut no attempt has been made apparently to apply 
these categories to a variety of system tasks to give at least some 
indication of the extent and limitations of the categories (in the 
method performed, for example, by Christensen and Mills, D- 


That these categories have superficial face validity (and Miller's 
as well) is apparent. But, face validity is a treacherous footing for 
behavioral analysis. It would seem most desirable to attempt to 
establish face validity in some systematic way across a variety of 
actual system tasks to check to what extent the categories seem to 
account for human behavior in systems and to what extent they do not. 


2. There has been no evidence presented that these functions and 


tests have an redictive validity to actual system tasks. As Alluisi 
(19, Pp. 383) notes: "We have a problem with regard to predictive 


validity." He continues with the following comment: 


"In summary, what we have is content validity- the tasks appear to 
include the desired content, to cover the desired functions- and some 
construct validity. We see no immediate possibilities of obtaining 
direct measures of predictive or concurrent validity." 


3. The assumption that the tests noted in Table C-1 do in fact 
represent an adequate measure of the functions may be questioned. For 
example, the assumption that a single test- arithmetic computations- 
measures memory functions is to ignore completely a very large litera- 
ture (cf., 63, pp. 110-137) showing (1) that human memory is a multi- 
dimensional ability and (2) arithmetic computations is not a particularly 
good way of testing for memory functions. Second, the code-lock problem 
has no apparent face validity for the kinds of "a nterpersonal coordination, 
cooperation, and organization" found in such real systems as command and 
control, manned space flight teams, air traffic control, and the like. 
Third, it is difficult to believe that the single visual target- 
identification task is truely representative of human operator sensory- 
perceptual functions. In short, these tests appear to ignore the 
existing Literature with respect to construct validity and to raise 
some doubts at least with respect to content validity. 


It is puzzling, in fact, that with the emphasis on construct 


validity within the Alluisi categories that a very substantial literature- 
that on human abilities- has been apparently bypassed. 
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The Fleishman-Parker Approach 


The second, and opposing, approach is based on the methods of 
differential psychology and the identification of human abilities. 
Fleishman (8) has been most identified with this approach, and he has 
presented a thorough analysis and defense of the assumptions, techniques, 
and methods of this approach. Both Fleishman and his associates (cf., 
oO, 46) and Parker (cf., 19) have developed and used the so-called 
"experimental-correlational" approach to a rather wide variety of actual 
human engineering problems. 


In a vastly over-simplified version, this technique derives task 
taxonomies for the human operator as follows: 


1. The basic data for any realistic task taxonomy must start with 
human performance measures on a broad variety of actual tasks. These 
tasks may vary from simple laboratory tasks to actual complex man- 
machine system tasks. 


2. From the raw performance measures, it is possible to extract 
fundamental categories of behavior that apply across actual tasks and 
categories than can in fact predict human operator task performance. 


3. Through the accumulated investigation of many tasks, a basic 
task taxonomy can be evolved which is exhaustive for human operator 
tasks and which can be reasonably applied to "new" system tasks. 


4. The approach is experimental and quantitative, and assumes that 
factor analytic methods are valid for extracting the basic behavioral 
dimensions. 


5. One major end result of this process is that we can take system 
human operator performance and define quantitatively the basic human 
abilities that underly that performance. 


Resistance to this approach has been so widespread in psychology 
in general and human factors in particular that some general comments 
might be noted: - 


1. ‘The basis for much of the human abilities literature over the 
past 40 years has been based on very elementary laboratory tasks. 
Miller (16, p. 74) chooses to call these nonsense tasks, and notes: 
",..L believe it will be a waste of time to try to build a useful task 
taxonomy from a reference base of nonsense tasks." This statement 
ignores the extensive research literature based on actual operational 
tasks using the human abilities method (cf., 8, Table 3, pp. 362-363). 


2. There have been no rules established by which one can apply 
the task taxonomies derived from the human abilities literature to 
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system tasks. This requires no more and no less expert judgment than, 
for example, the Miller or Aliuisi taxonomies. 


3. The list of human abilities over the past 40 years has grown 
from Spearmen's "G" to an unknown but very large number of basic human 
abilities. The question has been raised as to whether or not a point 
will ever be reached where invariance will be found (cf., 65). Further, 
there have been relatively few attempts to organize this mass into a 
coherent theoretical framework (but see 51, 77 and particularly 63). 

At one level, Gagne and Fleishman (10) attempted to create some order 
in this literature in their unusual introductory psychology text. 


4. There is a widespread suspicion that factor analysis as a 
method is questionable and that the results of complex factor analytic 
studies may contain large artifactual components. 


It might be of interest to apply Miller's six utility criteria to 
the human abilities task taxonomies: 


1. If we are limited to 15 to 2 dimensions of behavior, these 
task taxonomies are already considerably beyone that point. As an 
example, some 75 dimensions will be used in the following sections. 


2. Assuming the face validity of the factor analytic techniques, 
the task taxonomy elements are demonstrably mutually exclusive and 
should imply maximum discrimination between observed behaviors. 


3. The general human abilities method certainly cannot be learned 
in a few hours or, for that matter, a few years. 


4. Published data in this literature has clearly demonstrated 
consistent and significant shifts in the learning process and in the 
operational tasks, explicitly suggesting training procedures. 


5. These taxonomies imply no direct prediction of human error. 
6. Assuming the validity of the factor analytic technique, these 
taxonomies explicitly and quantitatively partial out prediction levels 


for task behavioral elements. Non-predictable elements (random variance) 
is directly identifiable. 
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Selection of the Behavioral Dimensions 


In light of the preceding discussion, it is apparent that the 
present technical effort faced a rather critical theoretical and 
methodological task in selecting an approach to the definition of 
behavior dimensions. Our basic approach (see Chapter A) required some 
method of identification of the dimensions by which tests and test 
batteries could be organized with respect to what the tests measured. 


For several reasons, the results of the human abilities literature 
have been used in this study to develop a set of behavioral dimensions. 
Some 75 dimensions were identified. The basic set of 60 dimensions are 
given in Table C-2. The remaining dimensions (61-75) are discussed in 
Chapter D. 


With our present state of knowledge, the selection of any set of 
behavioral dimensions is an extreme but necessary risk. It is apparent 
that (1) no standardized task taxonomy is available and (2) the current 
literature is in a maximum state of conflict and controversy.* Be that 
as it may, this program required that some specific approach be 
selected if the test literature was to be coherently organized. 


Several advantages- and disadvantages- were found using this 
approach: 


1. As Fleishman (8) has néed, there is available a substantial 
body of experimental literature using realistic and operational tasks 
which show consistent results. This literature was very extensively 
examined in the derivation of the 75 dimensions. In some cases, such 
as for dimensions 1-17, a very solid experimental basis is available 
in the literature (57)- 


2. However, as will be noted, there were additional dimensions 
derived from the literature which did not fit easily into this set. 
Yet, they could not be excluded due to their direct implications to 
man-machine system tasks and the availability of reasonable tests for 
them. 


3. This approach inherently provides for a microlevel analysis 
of the behavior. Gross taxonomies such as those of Miller and Alluisi 
simpley do not allow for examination of the detailed task structure of 
man-machine system behavior and particularly of that behavior of interest 
to this program (See Chapter B). 


* Miller (16, p- 74) notes: "Acceptance by psychologists at large as a 
criterion of the validity of any taxonomy is a forlorn hope, but 


probably the only one if my analysis is even reasonably right." 
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TABLE C-2 


The 60 Behavioral Dimensions 


A. INDIVIDUAL GROSS BODY MOVEMENT ABILITIES 


1. Explosive strength: general 
2. Explosive strength: Leg emphasis 
3. Explosive strength: arm-shoulder emphasis 
4, Static strength: arm-hand-shoulder emphasis 
5. Static strength: leg, trunk emphasis 
6. Dynamic strength: arms-flexer emphasis 
7. Dynamic strength: arms-extensor emphasis 
8. Dynamic strength: legs 
9. Trunk strength 
10, Extent flexibility 
LL. Dynamic flexibility 
12. Gross body equilibrium 
13. Balance-visual cues 
14. Speed of Limb movement: arms 
15. Speed of limb movement: legs 
16. Gross body coordination 
17. Stamina: cardio-vascular endurance 


Cee a ee een ee ee ee) 


18. Meaningful memory ability 
19. Verbal knowledge 

20. Word fluency 

el. Numerical ability 

22. Concept fluency 

23. Discovery of principles 
2h, General reasoning 

25. Seeing implications and consequences (foresight) 
26. Flexibility 

27. Symbol manipulation 

28. Logical evaluation 

29. Practical judgment 

30. Intelligence 


Category I: Fine Manipulative Abilities 


31. Arm«hand steadiness 
32. Wrist-finger speed 
33. Finger dexterity 
34. Manual dexterity 
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TABLE C-2 (Continued) 
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C. PSYCHO-MOTOR ABILITIES (continued) 
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tegory II: Gross Positioning and Movement Abilities 


35-2 Position estimation 
36. Response orientation 
37. Control precision 

38. Speed of arm movement 
39. Multilimb coordination 
40. Position reproduction 


Category III: System Equalization Abilities 


41, Movement analysis 
42, Movement prediction 
43, Rate control 

44, Acceleration control 


45. Reaction time 
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47. Discrimination abilities 

48, Perceptual speed 

ho. Time sharing 

50. Closure abilities: speed of closure 

51. Closure abilities: flexibility of closure 

52. Auditory identification abilities: auditory rhythm discrimination 
53. Auditory identification abilities: auditory perceptual speed 

54. Spatial abilities: spatial orientation 

55. Spatial abilities: spatial visualization 


56. Associate memory: rote memory 

57. Associate memory: meaningful memory 

58. Memory span: immediate memory 

59. Memory span: integration I (large number of detailed rules) 
60. Visual memory 


h. The basic data in this literature is based, in general, on 
large subject samples with extensive measure sets over a wide variety 
of tasks including many human operator tasks. To the contrary, most 
of the tests developed strictly within the human factors applied con- 
text have been based on very selected tasks, with very few subjects, 
and often, unfortunately, with some question as to equipment reliability. 


5. Precise definitions of each specific dimension is a matter of 
great controversy (indeed, even in some cases to the point as to 
whether such naming is proper or not). However, relatively the meanings 
of the definitions are orders of magnitude clearer than the other 
methods provide and at least they rest on the identifiable variance 
components of the raw performance measures. 


6. There is a rather direct analytic relationship possible between 
these dimensions and the categories in the Miller and Alluisi taxonomies. 
For example, following Table C-1, these dimensions can be directly 
related to Alluisi's functions 2, 3, 5 and 6. Further, they can be at 
least tentatively identified as components in Miller's elements 2, 3, 4, 
5 and 6. Further, the structure of Table C-2 allows both for detailed 
analysis within the Miller and Aliuisi functions and analysis for 
dimensions beyond these Lists. 


7. The major advantage of the present conceptualization is that it 
allows an analysis not only of the man-machine system tests but the 
entire available psychological test literature as well. In the search 


for human performance prediction methods and tests- which is the objective 
of this program- it seems reasonable that all potentially useful know- 
ledge should be examined. 


Selection of Test Instruments 


With the dimensions of Table C-2 as a guideline, the human factors 
literature and the general psychological literature was examined for 
tests applicable to these dimensions. This resulted in such a sub- 
stantial body of information that separate volumes of this report were 
necessary to report the results. Volume IT presents a technical 
summary of the over 500 tests examined. Volume III (References 127- 
376) provides source information on these tests. 


When the initial basic set of 60 sociopsychological dimensions had 
been formed, an extensive search of the literature was instigated to 
locate tests pertinent to those dimensions (and to possible personality 
and group dimensions) and to obtain information on these tests which 
would allow them to be evaluated for use in a particular situation. It 
was necessary not only to locate an adequate set of tests in, if possible, 
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a variety of forms for each dimension, but also to provide sufficient 
information on each of these tests such that it would be possible to 
ascertain when an adequate measurement set, or test battery, had been 
developed for a set of dimensions. To this end, although attention was 
given to test catalogues, considerable effort was devoted to the factor 
analytic, correlational, and experimental researches, and to theoretical 
and methodological presentations. It should be made clear that not 
every test reviewed was entered into our test catalogue. For one thing, 
some tests obviously did not afford direct measurement of our dimensions 
(e.g., "Citizenship: Every Pupil Scholarship Test"). For another thing, 
when it became clear that an adequate and varied inventory of tests had 
been collected for a particular dimension, it was possible to be more 
selective when evaluating additional tests on the basis of data available 
and dimensional measurement demonstrations. 


When a test was located which was demonstrated, purported, or 
judged to measure a sociopsychological dimension, an attempt was made to 
obtain the data necessary for evaluation of the test and to make this 
information available as an entry in an annotated bibliography. Examples 
of items of information that may have been obtained for any particular 
test include: test descriptions; dimension loadings as determined by 
factor analysis; content or predictive validities as determined, e.g., 
by correlational analysis; stress sensitivity of the test performance as 
determined by experimental procedures; test reliabilities, normative 
data, and costs; and any additional information which appeared useful. 


With the accumulation of test instrument data, it became necessary 
to develop a system whereby that information would be available as needed. 
With this in mind, indexes and an information classification system were 
developed to answer these questions: 


1. What tests are available to measure a particular sociopsychological 


dimension? 


To answer this question, the Ability-Test Tables found in Volume IT 
of this report were developed, where the tests are indexed with respect to 
the selected set of 75 sociopsychological dimensions plus additional 
dimensions which appeared to be of interest. For example, if one wished 
to measure dimension number 34, Manual Dexterity, one would turn to pages 
63-66 of Volume II. On these pages would be found, in tabular form, the 
set of tests available to measure Manual Dexterity, the factor loadings 
or correlation coefficients for Manual Dexterity which have been reported, 
and the other dimensions also measured by each of these tests along with 
their associated factor loadings or correlation coefficients. 


ho 


2. What information is available on a particular test? 


An alphabetically ordered Test Index has also been included in 
Volume II. The Test Index provides cross references to both the Ability- 
Test Tables and to the Annotated Bibliography of Volume III for each 
test appearing in the Tables. The bibliographic entries pertaining to 
any particular test are cited under on or more of the following headings: 
Data, Descriptions, Costs, Measures (information regarding what the test 
measures), Stress Experimentation, and Other Experimentation. 


3. Can all the measurement information available in the Annotated 


Bibliography on a general category of sociopsychological 
dimensions be surveyed? 


Attempts to group bibliographic entries were limited by the wide 
range of dimensions tested in some of the researches; i.e., it was 
desirable to avoid the problem of extensive cross referencing. It was 
possible, however, to categorize the test literature section of the Volume IIT 
pibliography dealing specifically with test literature (pp. 441-338) to 
some extent with the following chapter headings: Gross Body Movement 
Dimensions; Cognitive, Perceptual, Psychomotor, and Memory Dimensions; 
Personality and Social Dimensions; Vision; Miscellaneous; Performance 
Panels; Simulators. 
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Conceptual Structuring of the Dimensions 


Implicit in the adoption of the dimensional approach to human 
performance prediction was the assumption that it would be possible to 
denote a set of specific procedures which would define a comparatively 
objective mapping process, a mapping process that would be objective in 
the sense that the accuracy of the mapper would be more a function of 
available knowledge, than of the goodness of his intuition. (Mapping, 
as used here, refers to the a priori selection of those sociopsychological 
dimensions which would be required to perform an operational task.) 
Efforts to develop such procedures based on the currently available 
conceptualizations were not, however, satisfactory. As the development 
of a prediction methodology progressed, it became increasingly clear that 
the output of the efforts to bridge the human-task performance gap was 
necessarily a function of two things: 1) the conceptual definition of 
the dimensions and 2) the conceptual organization or structure of the 
dimensions. The various existing definitions and structures are the 
results of careful a posteriori analyses and appraisals of empirical 
data. The attempts to use these a posteriori and relatively static 
definitions and structures as a basis for an a priori prediction metho- 
dology for complex tasks performed under variable conditions proved, 
however, to be very difficult and it became evident that a redefinition 
and restructuring would be necessary. 


Current Conceptual Definitions of the Dimensions 


Ability dimensions: the most common definition given to factor 
analytically derived dimensions is that they are abilities, or essential 
constancies, whose combination will both describe an individual and 
serve to differentiate him from other individuals. Fleishman defines 
abilities with the following comments: 


"These are fairly enduring traits, which in the adult 
are more difficult to change....at a given stage of life, 
they represent traits or organismic factors which the 
individual brings with him when he begins to learn a new 
task. These abilities are related to performances in a 
variety of human tasks." (58, p. 148 and 8, p. 351). 


Most of the dimensions in our set have been found and interpreted 


by persons using the "abilities" definition (e.g., Fleishman, Guilford, 
Thurstone and Woodrow) . 
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Task Dimensions Another, less common, conceptual definition of 
factor analytically derived dimensions is that they are task classifi- 
cation factors or "task components". Jones (67) represents this point 
of view with these statements: 


"According to the minority view, differential elements arise in the 
first instance and are organized according to genetic, physiological, 
and learning principles which bear no essential relationship to the 
correlations we observe among tests. These correlations are determined 
by the tests....Correlations among tests reflect the organization of 
the tests, not the people who take them....the number of factors which 
can be discovered in any area is not Limited by any organization inher- 
ent in human beings. It is limited only by the industry and creativity 
of test makers." (p. 132) 


Current Conceptual Organizations or Structures for the Dimensions 


Any attempt to evaluate the obtained dimensions with respect to 
goodness, completeness or contribution to the understanding of the human 
animal requires that they be organized in a manner that appears to be 
logically sound. The three dominant structures today from the abilities 
standpoint are: the simple structure, the hierarchical structure and the 
three-dimensional matrix. 


The String Model, based on the normative, or task component, defini- 
tion, appears to represent a major conceptual organization of this 
viewpoint. 


The simple structure is almost a lack of structure in comparison 
to the other two. Developed by Thurstone, it assumes that an orthogonal 
independence exists between the a? eee and that the multiple regression 
prediction equation, Y = by, xX, + Po Xp t+ .o--t Sy Xp, completely 
describes the organization of the factors; i.e., they each contribute 
to performance independently and bear no relationship to one another. 

A task, then, is considered to require a specific amount of each of the 
dimensions and an a priori mapping procedure would require a non- 
structured, albeit intuitive, search among the available dimensions. 
Fleishman's work on psychomotor abilities appears to be an example of a 
programatic effort based on this conceptual structure. 


The hierarchical and matrix frameworks represent tools and relatively 
internally consistent and logical models which either have proved or may 
prove to be very beneficial to either the development of understanding 
of the human or as methodologies for a particular application. Burt's 
Hierarchical model and Guilford's SI Matrix model represent major efforts 
to understand the organization and operation of an internal cognitive 
realm. Guilford's concept of a dimensional behavioral space and con- 
tinued efforts to identify these dimensions have been particularly 
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stimulating (63) and fruitful. A major contribution of Thurstone's 
Simple Structure has been the repeated demonstrations that a limited 
number of dimensions could account for a large number of behaviors. 

The Simple Structure has been used successfully for the prediction of 
the performance of one individual on a small, well-structured task, for 
the analysis of skill development and a posteriori predictions for the 
individual on criterion tasks from batteries of ability measures (e.g., 
137, 163) and for the development of test batteries that may be useful 
for assessment of current performance level (190, 372) in the individual. 
Jones’ String Model may prove to be the necessary approach for the develop- 
ment of more efficient training programs (67, 61). 


Application of the above definitions and structures to the present 
project presented difficulties, however. If the "abilities" definition 
is adopted then the mapping problem becomes a difficult and tenuous one. 
The mapping must be made from an internal set of abilities which 
represent an individual person over to a distinctly disparate task. ‘The 
Simple Structure, Hierarchical, and Matrix organizations of ability 
dimensions do not conceptually bridge the gap between the two separate 
entities. The Hierarchical and Matrix ability frameworks serve to 
describe the internal organization of the individual; but they do not 
describe how the individual outputs to the external world. And, although 
the Simple Structure is sometimes considered to constitute a task 
taxonomy (e.g., S)4 again the framework does not imply how the dimen- 
sions are organized into an output. 


The use of the "task components" definition and it's related model 
focuses attention entirely on the other half of the person-task combina- 
tion: the task. Selection and prediction are considered only in terms 
of performance on the task and on various levels of task complexity. 

The framework is internally oriented in much the same way as the 
Hierarchical and Matrix "abilities" frameworks with no functional relation- 
ship to the differential characteristics of the human being implied. 
Further, although research indicates that this approach may be useful for 
the development of efficient training programs (61), the researches also 
indicate that it is incapable, in its present form, of predicting total 
task performance from component task performance (62) without extensive 
research on that task. 


In summary, then, the currently existing frameworks have been 
useful for particular purposes, but did not provide the structure needed 
for the mapping process. For our purpose, it was necessary to concept- 
ualize the sociopsychological dimensions in a manner which would allow 
the prediction of individual and group human behavior under a wide range 
of circumstances; particularly, the prediction of operator and system 
performance in ongoing, dynamic and complex man-machine systems (like, 
e.g-, the air traffic control situation) was desired. To reach such a 
goal it was necessary to 1) define the sociopsychological dimensions in 
a@ manner amenable to a priori evaluation of the operational situation in 
terms of the dimensions, and 2) to organize the dimensions in a manner 
which would aid the a priori selection of those dimensions required for 
the operational performance. 
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Definition of the Sociopsychological Dimensions as "Performance" Dimensions 


"Abilities" and "task components" are actually hypothetical labels 
which support constructs of the psychological structure of humans and the 
normative structure of tasks. In factor analytic studies, however, it 
is actually criterial measures of performance that are taken on a set of 
individuals over a large battery of tests and tasks. Some representative 
performance measures include: number of correct answers, amount of delay 
or time required, number of errors, accuracy or amount of deviation from 
a standard, and various measures of intensity as, for example, force. 

The factor analytic technique than manipulates these measures such that 
commonalities are established across the measure set. These commonalities, 
called factors or dimensions, provide both the essential terms of perfor- 
mance prediction equations and, as the term "commonality" implies, the 
common performance components across tests and tasks. 


It is intended, then, that the dimensions be understood to represent 
the human organized and differentiated in terms of performance. That is, 
they are considered to provide the answers to the questions: “How did 
that man, or that group of men, go about DOING, or accomplishing the 
task?" "What were the differential elements of DOING that created, and 
will therfore account for, the performance or behavior variance?" If 
the factors are conceptualized in this manner then the gap created by 
the separate and disparate entities of individuals with "abilities" and 
tasks with “task components" is considerably diminished and more amenable 
to objective appraisal. 


If the dimensions are conceived of as performance components, 
attention is no longer focused on the internal structure of only the Man , 
or the task. Rather, attention can be directed towards an appraisal of 
the demands on the human implied by: 1) the task structure in a particular 
environment, configuration and/or system and 2) the particular measure- 
ment of performance that is under consideration. 


The concept of performance dimensions which are common to tests and 
operational tasks also fits in with an often tacit but basic assumption 
that is made with regard to the usefulness of tests, simulator perfor- 
mances, experimental conditions and training devices. That assumption 
is that what the person is required to do, or perform, in the test 
situation, he will also be required to do in the real operational 
Situation. In other words, the tested performance elements, or dimen- 
sions, are expected to recur in the operational environment if the 
simulation has content validity. If stress is introduced and performance 
is affected, then degraded performance is expected to recur in the real 
situation. The operational environment may require additional performance 
elements but it is assumed that most of the tested elements will form at 
least a subset of those needed. 


If the above paragraphs are accepted then four statements can be 
made which bear directly on the methodology development and on the 
methodology evaluation. 
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1) <A simulation continuum exists extending from very narrow and 
specific tests (e.g., some paper and pencil personality and IQ tests and 
the Two Plate Tapping test) on the one hand to very extensive full dress 
simulations on the other hand. 


2) The empirical factor analytic and multiple regression studies 
indicate that commonalities and predictive relationships exist between 
levels on the simulation continuum; and between simulations, i.e., tests, 
and real-world situations. 


3) An organization of the dimensions is possible which will allow 
them to be used for both individual and man-machine levels of prediction 
in a system framework. 


h) Placement of the emphasis on common performance components 
rather than on abilities, disparate from tasks, clarifies the a priori 
mapping process such that it becomes possible to define the process in 
objective terms. 


It was considered desirable, if at all possible, to use the 75 
performance dimensions directly in the person~-task mapping activity. 
Random search guided by unstructured intuition was not a reasonable 
approach, however, if objective, quick and reliable mapping was desired. 
It was therefore necessary to develop a structure for the dimensions 
which would both guide and facilitate the mapping activity. 


With the performance perspective in mind, it became evident that 
the dimensional set could be organized with respect to two parameters: 
1) general performance descriptors and 2) human physical and interactional 
categories. It further became evident that the physical and interactional 
categories could be ordered into an input-processing-output system 
paradigm such that the input-processing boundary intersected the Per~ 
ception category and the processing-output boundary intersected the Output 
Selection or decision-making category. The general form of the matrix, 
or human-task mapping guide, is presented in Figure Cl. The complete 
detailed matrix for the individual with explanatory notes is given in 
Figure C-. The suggested group matrix is given in Figure E-l. 


It is intended that the column headings should force orderly 
consideration of the human organism in terms of the demands made by the 
task, the task configuration, and the physical and social environments. 
It is intended that the row designations, or performance descriptors, 
should facilitate the search for that particular small subset of the 
dimensions which describes what the individual is doing, or needs to do, 
with the required column headings in terms of the criteria for that 


oy) 


SYSTEM ANALYSIS CATEGORIES 


HUMAN PHYSICAL AND INTBRACTIONAL CATEGORIES 
| 
1 
| 
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Receptors Cognition | 


Perception Output l Gross ! Psycho- 


Selection Body | nouOr 


PERFORMANCE 
DESCRIPTORS 


Figure C-1. The general form of the human-task mapping guide is 
given (the shaded areas indicate the dimension 
distribution tendency). 


performance. The performance descriptors are not considered to be 
absolutely accurate nor even necessarily the best ones. But they are 
considered to serve as an initial list to aid the initial mapping 
activities. It is expected that with experience and experimental 
applications the list will be altered and possibly extended. 


The matrix allows conception of human performance within the input-~ 
processing-output flow paradigm used for analyses of complex systems; 
such as, for example, a dynamic man-machine system using a 3- to 5-man 
crew. Using this conceptual approach, it is then possible to consider 
analysis at several levels (e.g., individual, group, and system per- 
formances) with relationships between the levels defined in terms of 
the link and node constitutions. This will be discussed in greater 
detail in the final section of this chapter. 
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System System System i 
Input Processing Output : 


Interaction 


Figure C-2. 


The Performance Descriptor X Physical and Interactional 
Categories Matrix is presented as a human-task mapping 


guide. 


It will be noted that the positions of the dimen- 


sions within a matrix cell are, in some cases, varied with 
respect to the margin. The positional variations will 
indicate either one of two judgments: 
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Within the Perception and Output Selection columns 
the positions are relative to the pertinent 

System Input, Processing and Output categories; 
i.e., the position indicates which system category 
was felt to be more appropriate. 


Within the other columns the relative positions 
represent judgments as to the relationships of the 
dimensions to each other. A recessed position 
indicates a dimension which appeared to describe 
an activity that was either "smaller" (Wrist- 
Finger Speed as compared to Speed of Arm Movement) 
or more specific (Seeing Implications and 
Consequences as compared to Logical Evaluation). 


at 
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A basic assumption and the resultant procedures. The utility of 
the grouping and ordering of the Physical and Interactional categories 


with respect to the input-processing-output flow paradigm is contingent, 
of course, on the correctness of a basic assumption. The assumption is 
that the performance measure taken on an individual can be correctly 
thought of as being sequentially dependent on the effectiveness of a 
series of activities. For example, how fast and accurately a particular 
switch is thrown (two possible performance measures) in response to an 
input from the system may be seen to be a function of: 


(1) the level of input effectiveness (e.g., how clearly and 
quickly was a CRI display seen as a function of Visual 
Acuity and Perceptual Speed), 


(2) The level of processing effectiveness (e.g., how well 
were the equations solved using the CRI information, 
possibly degraded in (1), as a function of Logical 
Evaluation, Numerical Ability and Rote Memory), and 


(3) The level of output effectiveness (e.g., how well was 
the movement selected and were the controls manipulated 
as a function of Response Orientation, Speed of Arm 
Movement and Manual Dexterity, enacting what quality of 
decision as a result of (1) and (2). 


There exists some empirical evidence that the assumption of serial 
activity and sequential dependence is correct in the simple case at 
least (e.g., 50 and 69). 


As has been implied in previous sections, it does not appear that 
the simple additive form is correct for the prediction equation except 
under very limited conditions (i.e., where certain terms assume zero or 
constant values). Until the relationships are tested and better under- 
stood, however, this form will be used for a demonstration of the above 
predictions, "how fast and accurately a particular switch is thrown." The 
relative contribution of each of the above dimensions to the output, or 
performance measure, is expressed by the size of the beta weight (beta 
weight functions are discussed in the next section) in the simple 
structure form of the regression equation. The order of the terms reflects 
the assumption that the measured level of the final performance output 
can be conceived of as being serially dependent on ordered sets of 
dimensions. The predictions, expressed as standard scores, would be 
derived as follows: 


y = fOxqy, Xo, re x75) 
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= Bi7va*h7va + Pus*hs + Input dimensions 
p2ixe1 + f28%28 + J56*56 + Processing dimensions 
f 34X3h + £36%36 + £38x38 + Output dimensions 


where y might be the individual's standing with respect to 
response time, accuracy or a weighted combination thereof; 


Xi represents the individual's standing on a dimension i; 


and, P; specifies the proportional contribution of that x; to the perfor- 
mance variance. , 


How extensive and complex a set of operations like the above is will 
be determined by: 


(1) the level of prediction, i.e., system, group or individual 
and 


(2) the time, skill and situational stress-motivation ranges to 
be covered by the one equation. 


The application of the matrix to prediction will be discussed in further 
detail in the final section of this chapter, and demonstrated in Appendix 
A for a set of activities occuring during the radiometry experiments, 
conducted on the Gemini V and VII flights. 


Benefits The matrix and its organization into a system analysis 
paradigm not only defines a set of procedures for the mapping and pre- 
diction activities, it also makes available some other important bodies 
of experimental research. For example, the extensive investigations of 
manual control (e.g., 75), information processing behaviors (e.g., 54, 73, 
308), and on the characteristics of performance when man is considered a 
processor are more assessible from this framework (e.g, Th). 


Either the appeal of the information processing framework for 
analysis purposes or the desire to tap the available performance liter- 
atures seems to have been the basis for some one-dimensional organizations 
of the sociopsychological performance dimensions which have appeared in 
print recently. Reilly and Cameron (372) and Teichner and Olson (76) have 
used the input-processing-output categorization directly to attempt to 
fit the human operator into the overall system. Fleishman, et. al. 

(9, 60), appear to be using a similar approach with a 
perceptual-cognitive-motor categorization which they are attempting to 
relate to task complexity and performance. Apparently, however, none of 
the above has yet utilized a second, performance related, dimension or 
attempted to specify mapping procedures applicable to more than one level 
within complex systems under a variety of operating conditions. 
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Two other sets of experimental and differential researches are 
made more pertinent to mapping within a systems analysis context in that 
they may be said to represent the interfaces between input and processing 
and between processing and output. These areas of investigation are 
perception, or spatial behavior, and decision-making, or output selection, 
respectively. In referring to Figures C-2 and H-1, it will be noticed 
that certain of the performance dimensions were assigned to these two 
categories. A substantial portion of the perceptual (e.g., 78, 79) or 
spatial (e.g., 165, 166, 330), researches are immediately available for 
use because they have evaluated both individual differences and effects 
on performance. 


Although only a Limited amount of the decision-making literature 
seems to relate to operational performance, it is extensive (55) and 
seems to provide a basis for evaluating the objective utility of each 
of a set of possible decisions. With further research efforts the 
processing-output interface may be more clearly understood and the 
relationships to subjective utility defined. 


A Conceptual Framew rk for Group Performance 


How to conceptually organize the performance of small groups ina 
meaningful manner, suitable for prediction purposes, presented perplexing 
problems of the same nature, but greatly multiplied as were met with the 
75 dimensions for individual behavior. A discussion and a tentative 
solution is presented in Chapter E. 
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Critical Evaluation of the Dimensions 


Introduction 


As discussed in Chapter A the dimensional approach to human perfor- 
mance prediction is a necessary one to effectively answer the question, 
"Upon what measures?". And, as discussed in this chapter, the factor 
analytic researches have yielded the most consistent, general, and 
satisfactory dimensions. In addition, they are sufficiently robust and 
quantitative to offer the possibility of being handled in a relatively 
exact analytical manner as, e.g., in prediction equations of the 
regression form. 


The very positive aspects of the dimensional approach will be 
briefly summarized with references to the pertinent detailed discussions 
in other sections. The technical problems and difficulties associated 
both with 1) the factor analytically derived dimensions as prediction 
tems and 2) with the adequacy and completeness of our set of dimensions 
will be elaborated upon in detail. It should be emphasized at the outset, 
however, that the problems primarily result from the lack of adequate 
current knowledge. The use of the dimensional approach, despite the 
technical difficulties, is expected to result in greater precision and 
more complete information than would be obtainable from empirical or task 
analytical efforts alone. Accuracy, precision and efficiency will not 
be maximized, however, until the problems and basic methodology have 
been evaluated in both the operational and the laboratory environments. 


Positive aspects of the dimensions 


One of the really positive aspects of the factor analytically 
derived dimensions is the fact that many of them have been demonstrated 
to represent commonalities across a wide range of tests and tasks that 
occur relatively consistently. The existence of such commonalities 
implies that measurement efficiencies are possible when predictions must 
be made to a large number of tasks. 


A second very important feature of the dimensions is the fact that 
they represent relative constancies with respect to individuals. That 
is, a person is identified as different from other people as a result 
of his score on each one of the dimensions, as, for example, his score 
on the Manual Dexterity factor. A full set of dimension scores should 
serve to identify an individual as occupying a unique location in a 
behavioral space. 
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The combination of the above two facts, 1) the sociopsychological 
dimensions represent commonalities across tests and tasks and 2) they 
represent constancies with respect to individuals,alliows the all important 
suggestion that a priori performance prediction may be possible. Given 
the development of an appropriate conceptual framework 
the dimensional approach, using primarily those dimensions which have been 
derived by factor analytic methods, may provide a vehicle for both perfor- 
mance prediction and performance level assessment. That is, a priori 
performance predictions based on measurements from a previously administered 
test battery and the concurrent evaluation of performance capability 
based on on-line measurements from an on-site test battery may become 
a reality. 


Finally, a list of the major positive attributes of the dimensional 
approach must include the advantages of using an approach which can 
benefit from the extensive performance data which has been collected 
throughout this century and from the attendent application methodologies. 
For example, criteria of well established value are already available for 
evaluation of test instruments to measure the dimensions and for optimizing 
the test selection process when developing a test battery. 


For a large number of tests there exists large quantities of litera- 
ture containing normative and validation data (e.g., 1394 reports are 
listed in the reference section for the Minnesota Multiphasic Personality 
Inventory in Buros' Sixth Mental Measurements Yearbook (226)). The 


dimensional approach makes it possible to take advantage of this previous 
effort. 


Further, it allows prediction equations to be initially structured 
in terms of the basic multiple regression framework. This facilitates the 
initial analyses in that attention can then be focused on beta weight 
functions within an equation of additive form. It again allows a large, 
already established, data base to be evaluated for current use. The data 
base in this case consists of the history of regression equations which 
have been developed in an a posteriori fashion to account for performance 
varlance. 


In summary then, the major positive aspects of the dimensional 
approach are a function of six attributes held by the sociopsychological 
dimensions: 1) they represent task commonalities, 2) they represent 
individual person constancies, 3) they provide the basic elements needed for 
performance prediction and assessment based on a measurement set, 4) they 
are measured by test instruments for which there exist well established 
evaluation criteria, 5) they make available an enormous data base 
concerning test performances and task performances, and 6) they fit 
into the basic structure of the regression prediction equation. 
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Problem 1. Technical evaluation of the factor analytically derived 


dimensions as terms in a prediction equation. 


In the process of reviewing factor analytic, experimental and 
correlational studies to obtain information on empirically established 
dimension-related measurements and demonstrated predictive validities, 
it became evident that clarity and consistency in the dimension- 
performance relationships were somewhat lacking. Comparison of the 
research studies in detail made it clear that resolution of the apparent 
confusion and inconsistencies lie primarily in the answers to three 
questions: 


1. What situational (e.g., task, environmental) variables 
influence the loadings of the socitopsychological dimensions 
on a particular test or task? In terms of a quantitative 
expression, the regression equation: if the size of loading 
fy defines the contribution of ability x; to performance 
measurement y, what parameters affect the size of By in the 
equation: 


y = Pimt Boxet ---+Bi mt - - - + 75 752 


In other words, what terms belong in the functions that 
determine the beta values and what is the nature of the 
functions? 


2. Were all the factors, or dimensions, contributing to perfor- 
mance on a particular test or task in the experimental environ- 
ment really identified? And, is it possible to estimate what 
effect identification of all the factors contributing to a 
test or task performance would have had on the reported 
loadings for those factors that were identified? 


3. Did there seem to exist any relationships between the dimensions 
or any dimensional structure? Or was orthogonality a justified 
assumption? 


Factor analysis describes a variety of procedures developed for 
the purpose of determining the minimum number of independent dimensions 
needed to account for most of the variance in the original set of 
variables, or performance scores. It is basically an analysis of the 
intercorrelations between a large number of measurements, often including 
20 to 40 tests in the reference test battery and sometimes an additional 
set of measures from a criterion task or tasks. The number of subjects 
must be large, usually between 50 and 500. ‘The determined independent 
dimensions represent commonalities across the measurement set which can 
be included in a regression equation for the most efficient and effective 
prediction of performance on a criterion task. 
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Various factor analytic approaches have been the primary 
tools used in search of support for the abilities constructs, where 
rotations of the axes are performed until the reference axes are located 
in a position which gives a satisfactory psychological "ability" inter- 
pretation. This set of analysis techniques is a particularly powerful 
and effective tool and has repeatedly shown its usefulness both for 
deriving the minimum set of measures required to account for the maximum 
amount of performance variance and for the verification of hypothetical 
constructs of ability. 


Difficulties arose, however, in the attempt to apply this very 
large body of research to the problem of a priori performance prediction 
as a result of the failure of certain initial assumptions to hold up 
under close examination. The questions presented above were the result 
of the following assumptions NOT being adequately met by the reviewed. 
studies: 1) factor contribution to performance is consistent, 2) all 
the major factors contributing to the performances were identified, and 
3) the performance could be satisfactorily described as resulting from 
orthogonally independent factors. Any knowledge of prediction techniques 
and of logic should make it clear that the development of a performance 
prediction methodology imposes the requirement that the three questions 
be answered as completely as possible. 


Question 1. Situational variables affecting the regression equation. 


When a test battery is assembled, each test is considered independently 
and usually with the assumption that a particular test, A, will measure one 
or more particular abilities consistently. It should be recognized, how- 
ever, that changes in the test environment or test structure can create 

a different measurement situation so that different aspects of the 
individuals are being measured. This can occur not only in purposely 
structured, stressed, or distorted physical and social environments but 
also more subtlely in environments within which the experimenter has 

tried to maintain constancy. Even in the carefully conducted studies of 
Guilford and Fleishman, minor factor loading variations are expected to 
occur with each repeated use of a test in comparatively similar test 
environments; at times, however, rather drastic variations appear. The 
development of a performance prediction methodology based on test measure- 
ments requires the development of procedures which allow the causes of 
the more drastic loading variations to be expected and their effect 
properly described. 


One of the causes of variation which has been repeatedly demonstrated 
by measurement over a series of performances has been that of learning. 
The amount of previous training or practice on a particular test or task 
seems to determine to a rather large extent which dimensions will be 
required to perform the next time and what the relative contribution of 
those dimensions will be (19, 48, 137, 154, 161, 164, 179, 189). Examples 
which will serve to illustrate the effect of skill development may be 
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found in factor analytic studies which have been conducted using the 
Complex Coordination Task (161) and the Discrimination Reaction Time 
Test (163). 


COMPLEX COORDINATION TASK 


Visual- Spatial Mechanical Control Speed of 
Trials ization Orientation Experience Precision Arm Movement 
1-5 238 239 -28 48 -10 
60-64. .1O .10 18 U7 £20 


DISCRIMINATION REACTION TIME TEST 


Perceptual Spatial Verbal Reaction Speed of 
Trials Speed Orientation Comprehension Time Arm Movement 
1 LO 260 225 LL 200 
5 623 233 sOT -30 AL 


TABLE C-3. The factor loading variations which occur as a result of 
learning are presented for the Complex Coordination Task 
and the Discrimination Reaction Time Test. 


It will be noticed in the above examples that for the initial performances 
one set of dimensions is emphasized, but that a different set of dimensions 
is emphasized in the more thoroughly practiced and skilled performances. 
This change in dimension contribution to performance has been described 

as a shift of emphasis with respect to practice level from the cognitive 
functions to the motor functions. In the previous section (see Figures 
C-1 and C-2), the "Processing" category includes those dimensions 

more dominant in the initial performances, while the "Input" and "Output" 
categories include those dimensions more dominant in skilled perfor- 
mances. 


Once the learning variable is recognized as having an effect on 
which dimensions are found to be of primary importance in performance on 
a test or task (i.e., which dimensions will have higher loadings), it 
can be dealt with in the human-task mapping procedures and in the 
assignment of beta weights to the selected factors. The assigned beta 
weights can be the result of beta weight functions where the parameters 
(e.g., skill level) affecting the beta weights and their behaviors are 
defined. 
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The effects of the social and physical environments (e.g., motivation, 
stress) and of task structure (e.g., difficulty, goal definition) on what 
dimensions the test or task performance may require will also be discussed 
in terms of possible beta weight functions in Chapters D and E. Again, 
the effects of the parameters will be considered to be expressible as 
changes in the beta weights of the regression prediction equation. 


Question 2. The identification of contributing factors. As stated 
above, factor analysis may be briefly described as a set of methods for 
analyzing the intercorrelation matrix for a measurement set. As should 
be expected, the composition of the measurement set bears a complex 
relationship to the results of the analysis. 


The inclusion of two or more covarying measures from one test will 
tend to create a factor which loads very highly on that one test (sometimes 
called a test-specific factor). The inclusion of measures from two or 
more tests which are very similar will allow a common factor to emerge if 
the tests are, in fact, very similar. This last statement (in combination 
with the earlier one that rotations are made to locations which make 
psychological sense) is an important one in that it seems to be basic to 
some of the more drastic variations in factor loadings which occur from 
study to study. This can best be shown by an example (based on information 
abstracted from Ref. 190). The information given below lists the factor 
loadings for the Speed of Identification test which have been found in 
six different psychomotor factor analytic studies. 


Experimental Verbal Finger Perceptual Spatial Visual- 
Study Comprehension Dexterity Speed Orientation ization 

1 erate sibs wk oar 38 

2 er ree 4.3 ies ia. 

3 ran 33 AS ie Pron 

4 see tage ag 235 +29 

5 237 oles 251 -16 seat 

6 +20 -10 253 bee .06 


TABLE c-)., The factor loading variations on the Speed of Identification 
Test which occurred across a set of six studies. 


The review of a group of studies which have used a subset of tests 
in common makes an important reason for the loading variations on any one 
of the common tests (as in Table C-) apparent. The variations are seen 
to be a function of the varying composition of the measurement sets 
between studies; the battery of reference measures used and the body of 
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measurements taken on the criterion task if one is included. An intro- 
duction or deletion of highly similar tests, as are used in factor 
analytic studies, can cause the introduction or deletion of the major 
dimension(s) measured by those tests during the principal-component 
analysis as a function of the inter~correlational strengths that occur. 
Since the theoretically correct total of the factor loadings on one test 
remains 1.0 this implies a raising or lowering of at least some of the 
other factor loadings. As an example, note that in Study 5 above the 
Speed of Identification test loaded on Verbal Comprehension rather 
significantly. This did not occur because this was the very first time 
that the Verbal Comprehension factor had ever been used by subjects to 
solve the problems on this test, but rather because two (rather than one) 
decidedly verbal tests were included in the test battery (Word Knowledge 
and Background for Current Affairs). It was therefore possible for this 
sociopsychological dimension to be identified, in this study, as a 
contributor to performance on the Speed of Identification test. 


It is entirely possible that yet other dimensions contribute to 
test performances, such as the Speed of Identification Test, but have 
not been properly identified because measurements on these other dimen- 
sions have not been included in the measurement set. Experimental 
evidence is available that this may indeed be the case for some spatial 
tests with respect to a visual discrimination dimension and personality 
characteristics. 


An investigation of visual search performance conducted by Dorothy 
Johnston (330) demonstrated a relationship (-.5 correlation) between a 
measure of Peripheral Acuity and the Speed of Identification Test. 
Apparently, however, no factor analytic study of the spatial dimensions 
has yet included any measures of peripheral acuity or any other visual 
discrimination dimensions in their measurement set. 


At least thirty years of research into the nature of perceptual 
behavior (the transformation relationships between visual stimuli and the 
response) indicate the complex involvement of personality characteristics 
in the transformation operation. One of the more extensive and clear cut 
set of investigations, initiated by H. A. Witkins and his associates, 
has been that using a verticality judgment measure on an instrument known 
as the Rod and Frame Test, or RFT (e.g., 78, 79, 80, 198). These studies 
have uncovered close interrelationships between spatial abilities, 
primarily Flexibility of Closure, personality measures and general 
behavior patterns. Again, personality measures have not been incorporated 
into factorial designs investigating spatial or other behaviors. 


The change of factor contributions to psychomotor performance as a 
function of skill level was discussed previously under the first question. 
A question may also be raised, however, as to whether all the factors 
important to performance at the various skill levels have been adequately 
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identified; the primary question concerns the possible contribution of 
the memory dimensions. A comprehensive study by Allison (48) collected 
a set of learning measures on 13 tasks which was subjected to an inter- 
battery analysis using 36 reference tests covering several behavioral 
dimensions. Allison's results indicate the major common performance 
factors to be a conceptual process factor, a rote memory process factor, 
a mechanical factor, and a psychomotor coordination factor. (The con- 
ceptual process factor was considered under the first question.) 
Another indication may be found in an annual report by Melton (71) of 
completed investigations into the human information handling processes. 
The comment is made (p. 18) that short term and associative memory was 
found to be involved in a far larger set of tasks than had been expected 
(e.g., information processing, reaction time). The point of these 
examples is that, again, there is evidence that additional dimensions 
(memory in this case) are important factors in test and task performance 
(psychomotor in this instance) but that no factor analytic studies have 
been conducted which will allow their contribution to be evaluated. 


Perhaps the difficulty pointed up by the previous paragraphs can 
be said to have resulted from the assumption that persons can be made to 
do just one limited thing. The task or tests may place a heavy emphasis 
on one type of behavioral (e.g., paper and pencil, verbal or spatial 
problem tests as compared to the Two Plate Tapping Test) dimension, 
but rarely can they absolutely restrict the performance to only certain 
dimensions. The paper and pencil verbal test may emphasize verbal 
comprehension, but visual acuity, perceptual speed, and the psychomotor 
contributions to speedy handwriting (note appearance of Finger Dexterity 
factor on Speed of Identification Test) may also be expected to play a 
part in the output which constitutes a performance score. Whether the 
other dimensions which contribute to the final output have been identified 
or not will depend on whether measurements on performances which parti- 
cularly emphasize these other dimensions have been included and repeated 
in the measurement set. The result of the difficulty in obtaining 
complete factor identification and correct factor loading data on test 
instruments will be Less satisfactory predictions of performance from 
scores on test instruments than might have been achieved. Judgment will 
have to be exercised to a greater extent. For example, in setting down 
an a priori regression equation to predict visual search performance, 
what should the relative beta weights be for peripheral acuity and 
perceptual speed? Until the comparative importance of these two dimen- 
sions for visual search performance is empirically demonstrated, beta 
weights will have to be assigned on the basis of judgment. 
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Question 3: The orthogonal independence of the factors. The factor 
analytic procedures are such that "...the minimum number of independent 
dimensions needed to account for most of the variance in the original set 
of variables" (53, p. 151) is determined. The term "independent" 
indicates, of course, that a Knowledge of an individual's standing with 
respect to one dimension, A, will not imply the person's standing on 
another dimension, B. If two tests are available, one of which measures 
A exclusively while the other measures B, then the correlation of scores 
from these two tests should yield a Low correlation coefficient. If the 
correlation is relatively large then either the tests of A and B are not 
really exclusive measures of different, independent dimensions or else 
other causal factors are operating; such as the contribution of other, 
unidentified dimensions to the performance and an oblique, rather than 
an orthogonal factor structure. Which brings us again to the area of 
spatial abilities. These abilities seem to be involved in a wide spectrum 
of activities but their resolution into clearly orthogonal dimensions 
remains a problem. 


Upon review it appears as if the difficulties investigators have 
experienced with these dimensions have indeed stemmed from the presence 
of a large amount of commonality (e.g., high correlations and covariances) 
among tests of the independent spatial abilities, especially Spatial 
Orientation and Visualization. A particularly explicit discussion of 
this phenomenon is presented by Frederiksen who, in presenting the 
analysis of a bimodal perceptual recognition study, reports: "...the 
large covariance between Visualization and Spatial Orientation (.80) 
indicates that tests of these two "abilities" have much in common.” 

(166, p. 47) The effect this can have on identifying which spatial 
ability contributed to task performance is commented on in his discussion 
of the results: "The previous finding of a positive relationship between 
Visualization and late visual recognition was not replicated, despite 

the fact that the Visualization factor was clearly established in the 
factor analysis. Instead, the factor "Spatial Orientation" (included in 
our analysis in order to ensure that the Visualization factor would not 
be confounded with this ability) was related to visual recognition in 

the same manner as was Visualization in the previous study... Since 
Spatial Orientation and Visualization were more highly correlated in the 
present study than in the previous one, we suspect that the previous 
findings may have been due in part to a confounding of these two 
abilities." (p. 59). <A further example of difficulty with these two 
factors in particular may be found by referring to Table c-k which 

lists the varying factor contributions identified in performance on the 
Speed of Identification test in various studies. 


Fach dimension is assumed to operate independently of all other 
dimensions; in particular, each dimension is seen to be independent of 
any conditions imposed by other dimensions and to be unaffected by it's 
position within any sequence of dimensional operations. It does not, 
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however, seem reasonable to expect that dimensions such as Spatial 
Orientation or Perceptual Speed can operate without some minimum level 
of, for example, visual acuity being in effect. 


It has already been suggested. (under Question 2) that the nature 
of performance in activities using visual information to deal with 
spatial relationships could be clarified through the use of more widely 
varied measurement sets in the factor analytic studies. The question of 
oblique vs. orthogonal factors is a special problem, however, which has 
a bearing on the organization of the factors into a usable conceptual 
structure. 


The assumption of orthogonal independence (demonstrated by the 
particular analysis technique that is chosen) implies certain relation- 
ships between the dimensions. A high Peripheral Acuity score may not 
imply a high Perceptual Speed score, or vice versa, but it does seem 
reasonable to expect that a visual acuity standing could set an upper 
bound on, e.g., the attainable visual speed score. 


And, the results of the perceptual investigations (e.g., 78; 79) 
suggest that the assumption of orthogonality would also not be appropriate 
for the spatial dimensions with respect to hypothesized personality dimensions. 
The nature of the relationships are yet to be defined by empirical evidence 
but a limiting or bounding action on the spatial dimensions by some 
personality dimensions does seem a possibility. 


Not only may the operation of a dimension be bounded by Limiting 
conditions imposed by other dimensions, but its operation may be serial 
in nature even though the action time span is very short. For example, 
a recent study (50) indicates evidence of a serial execution of a 
stimulus decision and a response decision in a two-choice reaction time 
test. Again, a relationship between the dimensions is indicated--the 
possible score on Response Orientation, the response decision dimension, 
will be bounded by the goodness of the previously made stimulus decision 


(also see 69). 


The previous discussion has intended to point up the possible 
inappropriateness of the orthogonality assumption. It should be pointed 
out, however, that the composition of the subject population should be 
considered in determining whether the orthogonal assumption may be 
justified. The magnitudes of the intercorrelations which are subjected 
to factor analysis are affected by the characteristics of the population whose 
dimensions are being measured. If the entire subject population has, e.g., 
the same visual acuity and personality dimension scores then the bounds for 
the affected spatial dimension scores would be constant across the popula- 
tion allowing a decrease in commonality between tests of different spatial 
dimensions to occur. Or, in other terms, the spatial dimensions would 
appear to act in a more independent manner. 


TL 
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Problem 1: Summary 


A close review was made of several factor analytic and experimental 
studies to resolve an initial set of questions based on three assumptions 
which appeared to be inadequately met: (1) factor contribution to 
performance is consistent, (2) all the major factors contributing to the 
performances were identified in the studies, and (3) the performance 
could be satisfactorily described as resulting from orthogonally 
independent factors. 


It was found that the results of a factor analytic study (i.e., the 
dimensions identified and their loadings on each of the measurements) 
was a function of many parameters: (1) situational variables (e.g., 
training, stress, motivation) which impinge on the test or task perfor- 
mance, (2) the range of dimensions covered by the measurement set and 
the repetitive measurement of the same dimensions, and (3) a hypothesized. 
bounding action and the dimensional score range within the subject 
population. 


The analysis of the assumptions became necessary when efforts were 
made to generalize over a history of factor analytic and test research. 
These researches attempted to account for performance variance within 
limited activity realms through use of large test batteries consisting 
of highly similar tests. It should be recognized however, if it had not 
been for the volume of the factor analytic investigations and meticuLlous- 
ness with which they were conducted, a technical evaluation of the 
dimensions as a basis for a general prediction methodology would not 
have been possible. The fact that a definition of some of the variables 
and their effects on the results of these studies could be made is to 
the credit of the investigators. If the above assumptions had been 
consistently met by all the reviewed studies, then the dimension, or X,, 
values, and use of an additive function in the simple regression 
equation: 


y= PL X tho Xt eee ee +B XH, 


would have been exactly right. And, given a person-task mapping pro- 
cedure, the assignment of °; values would have been much simpler and 
would have had a much greater likelihood of being accurate. 


The immediate effect of the discovered parameters is the incorporation 
of these parameters into the person-task mapping procedure discussed in the 
next section. The effect of these and possible other parameters on 
future investigations should be to collect measurement sets and to 
perform analyses which will (1) define the terms and the operation of 
beta weight functions and (2) allow consideration of multiplicative or 
other functions for the combination of the dimensions. For the purposes 
of this report, however, the additive form of the regression equation 
will be used for demonstration purposes. 
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Problem 2. Evaluation of the dimensions as members of a necessary and 


sufficient set. 


The Necessary Set. After the initial set of sixty dimensions had 
been formed, the collection of measurement data for these dimensions was 
initiated. The existence and general usefulness of the majority of the 
dimensions was evident throughout the literature; both from the repeated 
empirical evidence and from the conceptual sense they generated. ‘The 
same comments do not hold for all the dimensions, however. Below are 
listed those dimensions whose existence and/or general usefulness have 
not been substantiated sufficiently to allow them to be used with 
complete confidence for prediction of the behavior of a subject popula- 
tion over a wide range of tasks. The basis for questioning the member- 
ship of each of these dimensions in a necessary set will be briefly 
discussed. 


18. Meaningful memory ability 
27. Symbol manipulation 

29. Practical judgment 

30. Intelligence 

41. Movement analysis 

42, Movement prediction 

i, Acceleration control 

46. Mirror tracing 


Meaningful Memory Ability and Symbol Manipulation have appeared in 
one study each (140, 175). The studies were conducted to validate the 
existence of a small subset of the cells in Guilford's Structure-of- 
Intellect Model. These factors have been identified only by their 
loadings on two or three tests within a relatively restricted set of 
paper and pencil tests and, therefore, only these few tests are known 
to measure these factors. Further, an examination of the test instru- 
ments raises questions as to their true definition (i.e., how would they 
fare as independent factors if measurements for certain other dimensions 
had been included in the analysis) and of their relevance to more than 
avery specific type of task. 


Movement Analysis and Movement Prediction have occurred in only one 
study (188) which was a second attempt to identify the dimensions 
responsible for performance on an acceleration tracking task (Tracking 
Task, criterion). Since measurements of neither cognitive nor spatial 
dimensions were included in this factor analytic study, a serious 
question can be raised as to the "real” definition of factors 41 and 42. 


The tests of these factors are visual displays which require an evaluation 


of the events displayed (Double Differentiation, Single Differentiation, 
and Double Differentiation/Integration tests). It may be that perfor- 
mance of an acceleration tracking task does require a unigue, task- 
specific set of dimensions; but this will not be satisfactorily 
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demonstrated until the performance is investigated with a larger 
measurement set which includes spatial and cognitive dimension measures. 


Practical Judgment was identified in the factor analytic studies 
conducted during WWIT using military personnel and is measured by a test 
developed during this period. Although it would be nice if a general 
Practical Judgment factor existed and could be measured, this factor, 
measured by this test, is apparently not it. One, the content of the 
sample questions for the test do not seem to fit the construct of practical 
judgment very well and two, further efforts to demonstrate the existence 
of 29 as a general factor have not been met by success (63). 


Factor 30, Intelligence, can perhaps be best defined either as 
being that which is as of yet undefined or as a general category descrip- 
tor. The "intelligence" tests are usually collections of items which 
have been shown to variously tap conceptual, thinking, and perceptual- 
cognitive abilities (149). In research, measures of "intelligence" are 
often taken to better control the relatively undefined characteristics 
of the subject population. The fact remains, however, that no dimension 
has yet occurred in American studies which could not be defined in more 
exact terms than the word "intelligence". 


There exists another set of factor analysis techniques, used 
primarily in England, which partials out the performance variance in 
a different manner and which serves to validate constructs like the 
"Spearman g Factor". The inclusion, however, of data and dimensions 
from that body of research would be difficult both in terms of data 
accessibility and in the conceptual and technical development of a 
prediction methology. Thus, although it may be possible to demonstrate 
an "intelligence" factor, it does not appear desirable to incorporate 
data from studies of this type. 


Acceleration Control and Mirror Tracing are questioned because 
their existence has never been demonstrated. Apparently these dimensions 
were hypothesized to exist by Parker, et. al. (190) in an effort to 
account for and test activities described by a task analysis of the 
Gemini space mission. The terms, Acceleration Control and Mirror Tracing 
are really task descriptions and not the psychological ability definition 
of rotated principal-component ames. 


If by Mirror Tracing is implied a "freedom from set" factor, an 
argument for its existence can possibly be constructed. For one thing 
performance on the two tests listed in Volume II for this dimension 
which have been included in factor analytic test batteries (Pursuit 
Confusion: Time-on-Target and Errors) was not completely accounted for 
by identified dimensions. They were included as measures of Mirror 
Tracing because the tests are just that - Mirror Tracing. Another 
body of research which suggests the possibility of a "freedom from set" 
factor is that using the Stroop Color-Word Test (272). 

This test has an annoying tendency to load only on a test- 
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specific factor. It is sometimes described as measuring a tendency to 
"response interference" and tends to correlate with a wide range of 
behaviors, including psychomotor performance. 


Acceleration Control does not, however, seem as easily supported. 
As indicated in the comments on 41 and 42, the research on acceleration 
tracking has not yet been adequate to justify the proposal of a task- 
specific dimension like Acceleration Control. First it must be demon- 
strated that a regression equation including cognitive and spatial 
dimensions, as well as psychomotor dimensions, will not account for a 
substantial amount of the performance variance. 


The Sufficient Set Throughout the literature review, factor analy- 
tically derived or hypothesized dimensions other than those included in 
our initial set of 60 have appeared. Several of these dimensions have 
been included in the ability test tables of Volume II and are listed 
below: 


Auditory Memory 
Integration 

Spatial Scanning 
Length Estimation 
Mechanical Knowledge 
Aiming 

Vigilance or Alertness 
Time Estimation 
Visual Feedback 
Coriolis Reactivity 
Motion Sickness Susceptibility 
Spatial Disorientation 


Most of these dimensions (except for Aiming, Spatial Scanning and 
Mechanical Knowledge) have not yet been demonstrated by large scale 
factor analytic studies to either exist or not to exist as independent 
dimensions. If, in the future, factor analytic studies are conducted 
using measures of these variables it will be possible to evaluate 

their independent existence or their dependent relationship to the 
initital set of dimensions. If their independent existence is demon- 
strated and if they represent commonalities across a range of tasks 
(i.e., if they are sufficiently general) then their membership into the 
dimensional set will be required. In the interim, they should be 
considered only if the performance to be predicted is not adequately 
described by the suggested set of dimensions; but the description is 
made substantially more complete by the inclusion of one or more of the 
above possible dimensions. For example, the introduction of rotationally- 
induced gravity to a MORL would necessitate the introduction of Coriolis 
Reactivity tests to the predictive measurement set. Coriolis Reactivity 


73 


may not exist independently of the other 75 dimensions, or it may be 
eliminated through habitation, but until this is demonstrated empirically, 
it would have to be considered as a negative term in performance predic- 
tion equations for several of the MORL activities. 


The question of the completeness of the final set of 75 dimensions 
to account for a very large subset of the behaviors from the human 
behavioral universe will be alluded to again within the specific contexts 
of stress and personality (Chapter D), and group behaviors (Chapter E). 
The MORL guestion above was a specific sample of the general question 
being asked: Is the suggested set of 75 dimensions sufficiently complete 
to account for an adequate amount of performance variance in most behavioral 
situations? This question cannot really be answered, of course, until the 
dimensional set and the attendent prediction methodology has been applied 
to a range of man-machine systems. If the methodology is found to be a 
sound one then the completeness of the dimensional set can be evaluated 
on the basis of empirical data and direction given to efforts to generate 
a more complete set. 


It appears almost certain that additional dimensions may be needed to 
satisfactorily account for operator performance, especially in some special 
man-machine systems. The data at present, however, is not adequate to 
allow final decisions to be made on the completeness of or the required 
additions to the dimensional set. 


To return to the variables whose dimensional existence has been 
demonstrated (Aiming, Spatial Scanning, and Mechanical Knowledge), Aiming 
was found to be a necessary one for mapping the command and control 
activities of the astronauts during Rendevous and Docking and, to a more 
limited extent, the behaviors during the Celestial and Space-Object 
Radiometry Experiments (see Appendix A). 


Spatial Scanning is difficult to evaluate as nothing was found in 
the literature to clearly support it's independence from Perceptual 
Speed. If it is not distinctly separate from Perceptual Speed as a 
general factor then it is not needed to complete the set. 


Although Mechanical Knowledge contributes to performance on paper 
and pencil tool and equipment tests, it does not appear to be involved 
in task performance to any extent. If it were to appear at all, it 
might be expected in the initiates' behavior in a new situation where 
past experience or knowledge might facilitate the processing activity 
(see data in Table C-3). This was apparently the case in one study 
(161) where Mechanical Experience loaded at .28 during the first five 
trials on the Complex Coordinator. It might therefore be suggested that 
the Mechanical Experience factor be considered when initial Learning 
behavior is to be studied. 
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Mapping and Levels of Analysis 


During the previous discussions, reference has been made to the 
use of prediction equations of the additive regression form. (It has 
also been pointed out that although the oblique structures make better 
conceptual sense, their forms are not sufficiently well developed to be 
immediately applied to the present problem.) ‘The \p weights for standard 
score prediction have been used since they directly represent the relative 
power of each of the dimensions in accounting for the performance variance. 
It has been emphasized that the beta weights may bend to change with 
respect to certain parameters, such that those performance dimensions 
which predominately contribute to immediate task output under normal 
conditions may tend to diminish slightLy in importance while others 
gain. It has been suggested that if it is possible to construct beta 
weight functions then some combination of these parameters is expected 
to appear as terms in those functions. These parameters are given below 
with their expected effects on the beta weights listed, 


Parameters affecting Beta Weights 


1. Training, or skill level. The Processing dimensions (including 
the Processing half of the Perceptual category) tend to be emphasized, 
i.e., have larger beta weights, during initial performance. And further 
research on tasks like Acceleration Tracking may support a hypothesis 
that the Processing dimensions will continue to be predictive of perfor- 
mances even at high skill Levels in those situations which are more 
variable or non-stable. 


The Input and Output dimensions (including the Input half of the 
Perceptual category) tend to increasingly predominate as the skill level 
increases. The contribution of the Output Selection dimension of 
Response Orientation appears, however, to be relatively stable across 
skill levels. 


2. Environmental stress factors hysical and social. As the 
physical and/or social environments become increasingly stressful, those 
dimensions often: considered in personality research appear to account for 
increasingly greater portions of both the performance and the general 
behavioral variance. Selected dimensions of this type have been placed 
in the processing half of the Perceptual category, the Output Selection 
category, and the Interaction category of the matrix in Figure C-e. 


3. Task factors. If the nature of the task or the required 
performance on the task implies a particular stress (e.g., fatigue, 
extreme demand) or motivational problem (e.g., boredom) for the subject 
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population then the individual and group dimensions identified in (2) 
above may be expected to account for an amount of the performance variance 
greater than zero. 


4, What is to be predicted. Once the output has been identified 
by the task analysis, y needs to be defined with respect to at Least two 
parameters: criteria and time. To select the proper dimensions, one must 
identify exactly which of the many possible behaviors (e.g., speed, 
interest, grade point average) related to the output one desires to 
predict and the context (e.g., the behavioral sequence) within which it 
occurs. After the criterion for the behavior to be predicted has been 
defined, consideration must be given to the time period involved. As 

the duration of time period covered by y increases, the personality and 
group compositional dimensions begin to account for a significantly 
larger amount of the variance (e.g., y = words /minute typing speed as 
measured for five minutes compared to y = words /minute as measured for 
an entire year where absences and non-productive periods are included in 


the measurement) . 


Ihe Mapping Procedure 


The Performance Descriptor X Physical and Interactional Categories 
matrix, in Figures C-land C-2, represent a conceptual framework intended 
for use as @ human-task mapping guide. The columns, the Physical and 
Interactional categories, are to be considered in order, starting with 
the Receptor category, with respect to how the individual will interact 
with and meet the demands made by the task, the task configuration, and 
physical and social environments. Whether or not a particular column 
accounts for a significant portion of the performance variance should be 
decided in terms of the operational task requirements, modified as 
required by the beta weight parameters listed above. When a column is 
selected it is intended that the row headings, or performance descriptors, 
should facilitate the search for the small subset of the performance 
dimensions which describes the activity of the individual as defined by 
the selected column heading, again, in terms of the performance criteria. 
Application of the mapping procedure is demonstrated in Appendix A. 
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The Levels of Analysis 


Several levels of system description are possiblé, the level being 
a function of the node and link constitutions. Three levels of des- 
eription, system, group and individual, will be discussed here as a 
means of arriving at a set of performance dimensions and equations to 
predict human performance within a man-machine system. These same 
levels of description will again be used in a somewhat different manner 
in Chapter F to arrive at the subset of system performance criteria 
which are measured by man's performance, or outputs to the system 
(see Figures C-/ and F-1). 


SYSTEM LEVEL ANALYSIS 


| system 
Individual 
INPU or crew OUTPUT 


Figure C-4. System level analysis. 


Inputs: the system inputs to the human(s) must be specified. 
Examples of system inputs might be visual displays such as gauges or 
CRIs, auditory signals, environmental changes if an environmental sub- 
system exists, or force dynamics in a control situation. They may or 
may not reflect the effects of crew outputs. 


Outputs: the required outputs to the system would be defined in 
terms of the system performance measures and the boundary values that 
are established. Outputs to the system then would be only that subset 
of the crew actions which directly interfaces with and affects the 
system. Examples of measures of output to the system are time-on- 
target, frequency and amount of deviation from a target, errors, and 
response time. 


Processing: at the system level processing would be contained in 
the black box. Analysis at the group and individual Levels would 
investigate the crew's black box such that equations and values could 
be established for the output parameters, allowing system performance to 
be predicted and evaluated. 
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GROUP LEVEL ANALYSIS 


GROUP PROCESSING (1) GROUP PROCESSING (2) 


GROUP PROCESSING (3) 


Figure C-5. Three examples of group processing activity are given. 


If a sequence of activities can be established for a group (Fig. C-5) 
and if not too many internal loops or interactions exist (Figure C-5({1) and 
c-5( 2)) then it might be possible to identify a serles of individual 
inputs and outputs such that the quality of the terminal performance 
will be dependent on the quality of a serial set of outputs, each of 
which, in turn, will be dependent on the levels of reception and pro- 
cessing of the preceding outputs(as defined by prediction equations 
at the individual level of analysis using selected performance dimensions). 
In other words, it might be possible to structure a set of predictor 
equations for individuals which would allow some answers to be generated 
by a model reflecting a group activity structure such as in Figure C-5(1)&(2). 
An example of one type of task description appropriate to this level is 
the man-man, man-machine interaction analyses in Appendix A (Table AA-2). 


If, however, the processing black box of the system level assumes 
the interactional complexity of Fig.C-5(3) above » it is doubtful that any 
set of equations for the actions of individuals could either account for 
a substantial amount of the performance variance for the group output 
or do it efficiently. If group performance dimensions derived from group 
performance measures do exist as suggested in Section F, then system 
performance prediction and evaluation would best be done using this set 
of dimensions for the analysis. In this instance, inputs, processing 
and outputs would be defined in the same manner as at the individual 
level below. The difference would be the use of group performance 
dimensions rather than individual performance dimensions. 
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INDIVIDUAL LEVEL ANALYSIS 


INPUT OUTPUT 
— 


PROCESSING 


Figure C-6. The individual level of analysis. 


Inputs: at this level inputs refer to those dimensions which are 
required by the human organism to receive the system or the inter- 
action inputs. For example, Auditory Acuity and Static Visual Acuity 
are needed for accurate discrimination of auditory and visual stimuli. 


Processing: those dimensions concerned with handiing and trans- 
forming the input information such that the output is directed. 


Outputs: the dimensions which are incorporated into the observable 
output activity as, for example, Explosive Strength or Manual Dexterity. 
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Summary 


An attempt has been made to denote a set of comparatively objective 
procedures for selecting the subset of the sociopsychological dimensions 
required for prediction and evaluation of performance in situations 
ranging from simple to complex. Specified were the following: 1) the 
individual, group, and system levels of analysis, 2) the human-task 
mapping procedure, and 3) the parameters expected to influence the beta 
weights for the dimensions, i.e., the factor loadings on the operational 
performance. The above items were all discussed within the conceptual 
framework of the Performance Descriptor X Physical and Interactional 
Categories matrix developed earlier. 


It is hoped that opportunities will arise which will allow the above 
selection procedures to be tested for their utility and reliability when 
used by mappers knowledgeable in the dimensional approach. The accuracy, 
however, of the beta weight assignments cannot help but be largely a 
function of subjective judgment at the present time. It has been possible 
to suggest what parameters belong in the beta weight function and their 
general effect. Extensive empirical research is needed, however, before 
they can be exactly defined in a manner which will allow them to be used 
entirely objectively. 
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D. MEASUREMENT: PERSONALITY AND STRESS RESPONSES 


Introduction 


As was indicated in Chapter C the ideal goal is to be able to 
predict any measure of performance under all conditions. Sociopsycho- 
logical dimensions 1-60 appear to comprise 
a satisfactory initial set of dimensions for a priori prediction of 
performance in a wide number of tasks; as long as the predictions are 
short term with respect to time, under nonstressful operating conditions, 
not dependent on interaction with other persons and not dependent on 
the individual's perceptual or decision-making behavior. It is often 
desirable, however, to be able to predict and evaluate performances 
over long time periods, under non-optimal and, possibly, very stressful 
operating conditions, and where the final man input to the system is 
the result of or affected by interaction, perception and/or decision- 
making. It is expected that when performance is to be predicted for 
any or all of the latter conditions that individual differences will not 
be adequately accounted for until additional dimensions are considered. 
In other words, the prediction equation beta weights for these additional 
dimensions will increase to a value greater than zero under the latter 
conditions. The additional dimensions have been derived from those 
areas of research generally considered to cover the subject matter of 
"personality". 


Personality, within the field of psychology, is supposed to refer 
to the uniqueness of an individual, i.e., anything that differentiates 
people into individuals. Generally, however, emotional and behavioral 
tendencies are the focus of attention. Although the research literature 
of this area is both extremely extensive and intensive, it is extremely dis- 
ordered, conceptually and rarely related to performance. In those 
instances where the emotional and behavioral tendencies are statistically 
related to performance measures, they sometimes relate closely, some- 
times moderately and sometimes not at all. A review of these varying 
relationships has led to the conclusion that dimensions derived from 
the area of personality research would be needed to account for per- 
formances under the latter conditions stated above but not necessarily 
for the former set of conditions. 


Deriving these dimensions was not an easy matter and it is not 
known at present whether independent dimensions of these exact descrip- 
tions will be empirically demonstrated to exist in the factorial sense. 
They are, however, real in the sense that they are measured, the 
measurements have been generated by conceptual constructs, and their 
relationships to various performances and behaviors have been demon- 
strated. 
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Derivation of Dimensions 61-75 


The questions of: (1) the utility of the "personality" domain, from 
the performance standpoint, (2) whether it was possible to satisfactorily 
dimensionalize the domain, and (3) if such dimensions were measureable 
by an existing set of tools have been under continual consideration 
Since the beginning of this project. Considerable effort has been 
expended searching both the experimental and the theoretical literatures. 
for approaches which would provide answers to these questions. What 
was found was an extremely chaotic literature without any central con-~ 
cepts which afforded any direct means of organizing and integrating the 
results of this tremendous body of research into a human performance 
prediction methodology. Partial answers to questions 1 and 3 were 
evident, however. That is, (1) if performance variance was to be ac- 
counted for in more than a limited set of conditions then "personality" 
would have to be considered, and, with respect to item (3), certainly 
there existed a very large set of tests, of which some were well 
standardized. 


An immediate and absolute answer to (2) is not available. The 
various dimensional structures from the literature seem to each cut the 
universe that is a person in a different direction in different size 
cuts, and, while implying the whole person is involved, actually consider 
limited and different portions of that person. For example, we have 
Cattell's U-I structure of 36 dimensions (e.g., U.1.26. Self-realiza- 
tion vs. homespunness, U.1.36. Strong self-sentiment vs. weak self- 
sentiment) (229), Guilford's five Primary Personality Traits (e.g., 
Sociability, Objectivity vs. Subjectivity) (63), Guilford's GZTS for 
ten factors (e.g., Thoughtfulness, Emotional Stability) (278), 

Borgatta's five dimensions (e.g., Assertiveness, Intelligence) (222, 223), 
Witkins' two dimensions, Field Dependence and Field Independence (78, 79), 
Bass's Task-orientation, Seif-orientation and Interaction-orientation 
(214), Kugelmass's Worriers vs. Non-worriers (283), factor analytic 
efforts on the MMPI (cf., 274, 303, 315, 318), Freud's Ego, Id and 
Super-~ego (92), Goldstein's Self-actualization (89), and Sheldon's Ecto-, 
Meso- and Endomorphs (109). 


As the search continued, records were kept of the measurement tools 
described and especially those which were demonstrated to be predictive of 
performance. When a large set of tests had been accumulated they were 
sorted into a number of piles based on the similarity of the test 
contents and/or the similarity of the constructs they represented. 


At a later date these initial groupings were evaluated in terms of 
some other things that had become apparent. These were: (1) several of 
the initial groups could be considered as more specific subcategories 
for more general dimensions, i.e., dimensions that would be predictive 
over a wider range of tasks; (2) the best way to cut or categorize the 
"personality" domain, to make it relatable to performance, was with 
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reference to the situational impingement on the action, and (3) categories 
were also suggested by the particular positions which these dimensions 
seemed to occupy in the Performance Descriptor X Physical Interactional 
Matrix (see Figure C-3). The initial and final groupings are listed 
below in Figure D-1 with the effects of 1, 2 and 3 above indicated. 


It will be noted that the very first item of the initial grouping, 
Adjustment Potential, has not been included in our dimensional set. This 
dimension was the result of a factor analytic study of rated adjustment 
to and rated general performance in FRM submarines (321). Although the 
resulting dimension is of interest and is included in the Ability-Test 
Tables in Volume II, it was both too general and derived from a measure- 
ment set including too few a priori measures to allow it to be included 


in a dimensional set for a priori prediction. 


Dimensions 61-64 will be discussed in greater detail in Chapter E 
where the problems of group measurement and subsequent prediction are 
considered. 


Measurement of Dimensions 61-75 


The available measurement tools for dimensions 61-75 and information 
on these tools are given in Volumes II and ITI in the same manner as 
provided for dimensions 1-60. As indicated in the 
previous section, these dimensions have been derived from the measure- 
ment set and thus are primarily defined in terms of the tests for a 
dimension. It is also true, however, that the main orientation of this 
literature has not been in terms of performance prediction and, there- 
fore, it is not expected that the measurement tools for these dimensions, 
defined in terms of performance characteristics, will be entirely satis- 
factory. It is expected that the dimensions with the best measurement 
tools will be those which have been factor analytically derived and by 
more than one researcher, as for example, Subjectivity vs. Objectivity, 
dimension 72. 


Utility of Dimensions 61-75 


The utility of and, therefore, the need for dimensions 61-75 is 
indicated by the relationships they bear with certain variables impor- 
tant to prediction. Some of the available references which cover 
these relationships and, therefore, the utility of the dimensions are 
listed in Table p-1. The following definition of the variables and 
their apparent relationships to the dimensions should afford an under- 
standing of how these dimensions might provide more effective prediction. 
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Figure D-1. 


SITUATIONAL 
IMPINGEMENT 


Group 


Inter- 
individual, 
reactions to 
people 


Reactions 
to 
environment 


Values@——— 


The development of the personality and group composition 
dimensions, 61-75, is demonstrated. 


ASSIGNED 


DIMENSION 


INITIAL GROUPINGS 


NUMBER 


fle 
12k 


Th. 
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ASSIGNED 
DIMENSION MATRIX 
NAME ASSIGNMENT 


Adjustment Potential, Optimal vs. Limited 


Similarity, perceived 
Group compatibility 
Group cohesiveness 
Leadership 


Friendliness 

Sophistication, aloof 

Personal vs. counter- 
personal 


Introversion vs. 
Extroversion 
Withdrawal 


Assertiveness 


Agression 
Agressive nonconformity 


Dependency 

Power orientation 
Nonconfommity 
Conformity 
Authoritarianism 


Flexibility 
Abstractness capability 
vs. integrative com- 

plexity 
Rigidity 


Self control 


Self centeredness vs. 
objectivity 


Nervous tension 

Anxiety 

Emotional maturity, 
defense mechanisms 

Stress responsitivity 


Activity 
Aspiration 
Motivation 


Similarity, perceived 
Group compatibility 
Group cohesiveness 
Leadership 


Group 
Composition 


Closeness of 
interactions 
Interaction 


Amount of interaction 


Strength of interaction 


Aggression reaction 


Conformity and/or 
control reaction 


Flexibility: rigidity 


reaction 
Output 
Selection 
, or 
Self control reaction Input 
Subjectivity:objectivity | Perception 


reaction 


Emotionality, sensitivity 
of reaction 


Desired level of output 


Conscientious vs- Expedient 
Esthetics vs. practicality Desired type of output 


Happy-go-lucky vs. Sober 
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Time Period: This refers to the length of time covered by the per- 
formance measure one wishes to predict. When it is desired to predict 
an output which is contingent on the comparative maintenance of a high 
level of effort for long periods of time then consideration of dimensions 
1-60 often does not seem to adequately account for the individual dif- 
ferences in output. Grade point averages, production outputs measured 
on longer time spans, and cumulated errors for long term monitoring are 
examples of the type of measure which tends to correlate significantly 
with personality measures. 


Non-optimal situational variables: When either the task or the 


physical and interactional environments surrounding the task introduces 
stressful and/or motivational elements into the situation, performances 
tend to correlate with"personality" factors. The tendency is a complex 
one, but the researches surveyed thus far appear to support the following 
hypothesis: the degree of relationship between dimensions 61-75 and the 
task output level is a function of the stressor and motivator intensity 
levels present in the task activities and the task environment. The 

more stressful and less motivating a situation becomes, the more important 
these dimensions will become in fully accounting for the individual dif- 
ferences in level of task performance. 


Stress and motivation are usually defined in terms of individual 
response rather than external events. Knowledge of just the person's 
physiological response or anxiety level is not sufficient, however, to 
account for his performance. Stress and motivation from the standpoint 
of the individual's response will be considered further below. 


The position to be taken here is that external events can be termed 
"stressful" or "motivational, , if couched in terms of probable perception 
as stressful or motivational by the particular subject population under 
consideration (84, 116, 191 and 292 indicate that measured personality 
factors may or may not relate to performance as a function of whether or 
not the situation is motivating for all of the subject population). An 
example of such a stimulus definition for stress has been presented by 
Deese (87): "The properties of stressful stimuli are defined by a set 
of correlated responses. It will be useful, I think, to characterize as 
stressful those conditions which elicit reports of discomfort or which 
elicit correlates of discomfort." 


Stressful and motivational (especially boredom) characteristics 
for the task or the interactional and/or physical environment are then 
considered to be continuous variables which determine the degree to 
which dimensions 61-75 are predictive of the performance output. Example 
stressors might be sleep deprivation, situation-induced illness, extreme 
temperatures, prolonged performance or severe pacing, social disapproval 
or condemation, or unusual hazards. 
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TABLE D-1. A listing of some of the researches found 
which indicated the relationships between 
"personality" and certain measurements, 
situational variables and behaviors. 


NON-OPTIMAL, DECISION- 
TIME PERIOD STRESS INTERACTION . PERCEPTION MAKING 


99 
110, 116 


130 
147 
191 


207, 208 
234, 


213 
oh7 
252, 254 
257 
263, 268 
277 


292 


312 


* Numbers refer to citations appearing in Volume III, 
A Selected and Annotated Bibliography 
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Interaction: Whenever interaction between persons is part of the 
task situation, consideration must be given to the possibility of 
facilitation or inhibition of task output level as a result of person- 
ality characteristics. This is not to imply that group compatibility 
or cohesiveness is necessarily desirable. It may be that a higher level 
of group output will be maintained under the opposite condition, group 
incompatibility or incohesiveness. But if group interaction is a part 
of the system and the performance to be predicted is in any way affected 
by this interaction, then consideration should be given to these 
dimensions. 


Perception and Decision-making: Whenever an analysis of the task 
requirements imposed on the human indicate the possibility of differ- 


ential perception and/or output selection on the part of the individuals 
or groups which will have a bearing on the performance, dimensions 64-75 
will again become important. The amount of importance and which dimen- 
sions are necessarily functions of the particular performance being 
predicted. 


The utility of the above considerations rests on their connections 
with the basic prediction equation, 


y= Ax + BoXo + coe + BX 7 Baska 


They are interrelated and may, singly or in combination, increase the 
relative importance, or contribution to y, of any one of the dimensions 
61-75. For example, the first item, time period, represents one of the 
descriptors of y in the above equation. If the y covers an extended 
time period then the beta weights for one or more of these dimensions 
will probably increase. 


The non-optimal situational variables are considered to be candidate 
terms for possible beta weight functions. In other words, the beta 
weight value is felt to be functionally related to the intensity levels 
of these variables. 


The interactional, perceptual and decision-making variables all 
relate to the dimension-selection process, or the human-task mapping 
procedures discussed in Chapter C. As discussed there 
it is not felt that these dimensions should necessarily assume an 
additive form in the prediction equation; hopefully, research will be 
conducted which will allow the nature of their contribution to the 
prediction of y to be evaluated. 


Optimum Performance Prediction: Evaluation of performance 
maintenance and decrement and pinpointing when changes may be 
expected to occur may be possible if the above items are considered 
in combination. For example, performance decrement under 
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stress may be a function of: the nature of the stressor (e.g., degree 
of expected inecapacitation), the internal stress response on the part 

of the individual (e.g, physiological measures, the SSS and the STAT 
tests for dimension No. 73) 5 and the selection of output on the part 

of the individual (e.g., dimensions 71 and 74). The success of relating 
internal response alone, whether physiological measures or dimension 

No. 73 measures, to performance has been meager. The use of a larger 
framework may allow a greater amount of the variance to be accounted for. 


Summary 


A review of the personality literature made it apparent that a 
satisfactory conceptualization of this field, suitable for performance 
prediction in man-machine systems, was not available. It was also 
evident, however, that the test instruments developed within this field 
were predictive of performances where the conditions were long-term, 
non-optimal for the subject population, a function of various types of 
decision-making and perception, and/or a function of interaction vari- 
ables. To place this information in a usable format, dimensions 61-75 
were derived from the available "personality" measurement set. The 
purpose, then, of dimensions 61-75 is to increase the predictive power 
for those conditions where dimensions 1-60 may not account for an 
adequate amount of the performance variance. It is hoped that research 
will be conducted which will permit the existence and the definition of 
such factors to be demonstrated and which will allow the way in which 
they are predictive to be determined (e.g., multiplicative or additive, 
within what range of which boundary conditions, with what beta weight 
functions, etc.). 
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E. MEASUREMENT: SMALL GROUP PERFORMANCE 


The Studies of Small Groups 


The measurements popularly taken on small groups are almost entirely 
internally oriented and directed towards two considerations: the activity 
of and effects on the individual embedded within the group and the effects 
of group structure on internal activity. Examples of the internal mea- 
sures taken on groups include: Bales Interaction Process Analysis which 
records twelve activities like "Gives opinion" and "Shows solidarity", 
Hemphill's Group Dimensions Description Questionnaire, various attitu- 
dinal scales, similarity measures like the Assumed Similarity Between 
Opposites (ASo), various choice-of-group leader and power structure 
forms, and the frequencies of certain communications within communication 
structures. 


Measures of group output, when taken, are rarely task related. 
Satisfaction and enjoyment are often the accepted criteria. As Shaw 
reports in his review of experimental methods used for group study, "The 
task variable is one of the most neglected in social science research, 
and this is particularly true with regard to the group task variable " 
(123, 637) The most common task output measures are those taken on 
group discussion activities such as the number, goodness or originality 
of the answers. 


Pre-experimental individual measures are often collected, but 
unfortunately, usually only a few are taken to serve as a basis for 
grouping the individuals with respect to one or two characteristics. 


Little has been derived in the way of relationships between the 
variables mentioned above (individual characteristics, group output, 
internal group activity and group structure). The most effort has been 
directed towards demonstrating relationships between the measures of the 
individual and both group output and group internal activity (e.g., 98, 
119). Much of this effort is reflected in the selected group composi~ 
tional dimensions 61-64. Some 
researches have been located which attempt to discover interrelation- 
ships between individual measures, internal group activity and group 
structure. Currently, however, these researches do not appear to be 
applicable to the present problems as the relationships of group output 
to the internal group activity and structure do not appear to have been 
investigated. 


in summary, the available research efforts on groups appear to have 
been almost entirely related to the internal activity and structure of 
groups. The concept of a priori group performance measures for pre- 
diction purposes has not been studied or applied (with one exception 
to be discussed below). The reviewed studies ad the concepts with which 
they are concerned do not yield a good understanding of the relationship 
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between task demands, physical environments, group dynamics and group 
composition; or,even more importantly, these studies have not defined 
the combined effects of these variables on group behavior, especially 
group task performance in man-machine systems. 


In view of the group performance state-of-the-art, alternate 
approaches will be proposed and discussed below in terms of the com- 
plexity of the group task structure (as in Figure C-5). 

These approaches are amenable to quantitative prediction methods, given 
the research necessary to empirically demonstrate both their feasibility 
and the proper quantitative expressions. Reference is made to studies 
which support the feasibility and utility of these approaches. 


Group Performance Dimensions 
Suggested dimensions 


If the group within a man-machine system has a very simple and well- 
defined structure with respect to the tasks to be performed, it may be 
possible to predict the group output as a function of the predicted 
outputs of the individuals within the group. Certainly some ground 
rules have been established if the task performances can be viewed as 
being either in series or in parallel with respect to a final criterion 
measure (12)). 


If, however, the group task activity is more complex as, for example, 
in Figure C-5 then an analysis which directly relates the activities of 
the individuals to the group's actual output to the system becomes an 
impossibility. If it is desirable to measure a group such that the 
performance of that group can be predicted for one or more complex group 
tasks, tasks which cannot be broken into completely disparate outputs for 
each individual with said outputs organizable into a simple structure, 
then a different approach is needed. 


The approach to be suggested is congruous with the dimensional frame- 
work, consisting of primarily factor analytically derived dimensions. 
That is, if task performance measures were taken on a large number of 
groups, performing on a large number of varying tasks, and the data were 
subjected to factor analysis, then it would be expected that group perfor-~ 
mance dimensions would be obtained. These performance dimensions would 
load to varying extents on each of the tasks included in the measure- 
ment set; and, therefore, be useable in multiple regression equations 
which would account for some portion of the group performance variance 
on each of the reference and criterion tasks. 


It is expected that some complex relationship should exist between 
the group composition (e.g., dimensions 61-6) , the number of group 
members and the factor analytically derived performance dimensions. It 
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is further expected that the particular combination of group performance 
dimensions and their respective loadings on any group task output will 
be a function of: (1) the demands made on the group as a result of. 
what the group must do to produce an output, (2) the level of group 
practice on the task, and (3) various parameters such as the Length of 
time the group has performed together and the stressors and motivators 
which arise from the task and physical environments. 


At the outset it appears that the efforts of Shaw (29, 122) in 
establishing a dimensional scheme for group task structure and the 
efforts of Hackman (256) in organizing a set of group tasks with the 
avallable reference literature on each may provide an initial basis for 
research in this area. 


With this approach in mind the Performance Descriptor X Physical 
and Interactional Categories matrix for the individual performer 
(Figure C-2) was reviewed and modified for use with group performance 
dimensions. Presented in Figure H-1, an X appears in those row x 
column intersections which seemed to describe performance dimensions 
which could reasonably be expected to account for group performance 
variance and which, further, seemed to describe recognizable differences 
between tasks. 


Supportive background for the suggested dimensions 


Only one study has been located which has taken both individual and 
group performance measures and then related these measures to the per- 
formances of these groups in later and varying situations. In this study 
by Torrance (3212), both performances of the individual in the group 
setting and the performances of that group as a whole were initially 
measured in a series of three tests. The test measures consisted of 
performance ratings and scores and perceptual measures. The testing took 
place in the SAC Survival School and covered a sufficient number (133) 
of groups such that their operational group performance could be evaluated 
in one of the following situations: survival training, combat duty (where 
crew performance was rated by superior officers), or combat duty (where 
crew performance was rated by bombing missions failed). 


This is an especially remarkable study in that (1) the individual 
and group test measures were related to group performance measures in 
two varying field environments and (2) these measures were unusually 
successful in discriminating significantly between good and poor group 
performances. The best overall predictive measures were the ratings of 
performance and the perceptual measures taken on a picture of a formal 
group setting (which, incidently, most closely simulated the operational 
environment). These measures are described as follows: 


9h. 


INPUT PROCESSING OUTPUT 
Output 
Perception Selection 
GROUP 61. Similarity, perceived 
COMPOSITION 62. Group compatibility 
63. Group cohesiveness 


DIMENSIONS 


64. Leadership 
Group Performance 


Descriptors 
SENSITIVITY or - 
DISCRIMINATION x 
MANIPULATION | Xx 
| FLEXIBILITY | } X 
| KNOWLEDGES* | | x 
MEMORY | | X 
GENERAL REASONING | | xX 
! DEDUCTION, ANALYSIS | | 
INTEGRATION, 
COORDINATION x x 
PREDICTION, FEEDBACK r 
USAGE 


*Some of the descriptors are more clearly a direct function of the group 
membership measures than others. 


Figure E-1. Presents the hypothesized performance dimensions and 
selected compositional dimensions for the Group Performance 
Descriptor X System Performance categories matrix. 
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PERFORMANCE RATINGS PERCEPTUAL MEASURES 


Manpower utilization Satisfactory outcomes 
Participation Someone leaving group 
Coordination Orderly functioning 
Control Productive 
Flexibility 


These are at least three things of interest here. First, another group 
performance dimension was rated but, as would be expected in view of 
the nature of the criterion performance measures, did not discriminate 
between the groups. This dimension was Speed. 


Another item of special interest is the fact that an individual 
verbal-intellectual score was predictive of group performance only in 
survival training. This suggests a possible parallel to the tendency 
of cognitive measures to be predictive of individual performance 
primarily during the initial learning phase. 


The third item is important because it supports the suggested 
utility of using, as an initial set, those group performance dimensions 
suggested in the Performance Descriptor K System Performance Categories 
matrix of Figure E-i1. The above performance ratings are ones that 
might be suggested to measure dimensions described by the row Performane 
Descriptors of Integration and Coordination, Flexibility, Speed, and 
Selection, and compositional dimensions such as Group Cohesiveness and 
Leadership. 


Measurement and prediction of group performance 


The approach selected (and, therefore, the measurement pro- 
cedures used) as most effective for the prediction of 
group performance has been suggested to be a function of the level of 
complexity found to exist in the input, processing and output activities 
required of the group. If the procedures can be separated into rela- 
tively disparate sets of activities per person and if the input- 
processing-output flow is a simple one then prediction can probably 
be done primarily in terms of the outputs of the individual members. 
If, however, the group activities are more complex, but still must be 
predicted a priori without benefit of direct measurement on the tasks, 
then it is proposed that the x; terms of a multiple regression prediction 
equation should be group performance dimensions. An initial set of 
group performance dimensions has been hypothesized to exist. Although 
it is felt that the group’s standing on any of the group performance 
dimensions should be a function of the group composition, i.e., the 
characteristics of the individual members of the group, (in the same 
way, perhaps, that the individual's standing on an individual perfor- 
mance dimension may be a function of some transformation of internal 
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native characteristics), there is no empirical basis, at present, on 
which to make decisions as to: 1) what compositional factors would be 
needed to comprise a necessary and sufficient set and 2) what functions 
would be needed to translate measurements on these factors to predictions 
of group performance. Referring to the Group Performance Descriptors 
appearing in Figure E-l, in terms of item (2), Knowledges could probably 
be measured through direct measurement of the individual group members. 
Whether or not Memory could be evaluated through measurement of the 
individual members would, in all probability, depend on'the performance 
criterion to be predicted and the surrounding parameters. The remaining 
Performance Descriptors probably represent rather complex transformations 
of many compositional factors. 


It does appear, however, that the suggested compositional 
dimensions 61-64, and possibly others, would be useful for the prediction 
of group performance under some conditions in somewhat the same way as 
are the personality characteristics on which these particular dimensions 
are based. That is, when stress or unusual demand occurs, these com- 
positional dimensions are expected to play an increasingly important 
part in accounting for the behavioral and performance variance between 
the groups. The research literature indicates that at least two of them, 
Group Compatibility and Leadership, are useful for predicting the 
behavior and performance of the group under various stress conditions 
(e.g., confinement), task characteristics (e.g., goal path multiplicity) 
and group organizations (e.g., formal groups). 


Summary 


A review of the existing literature covering research 
activities and theoretical concepts within the area of group activities 
made it very clear that there was little available which was applicable 
to the problem of a priori prediction of group performance. A dimen- 
sional approach was suggested based on group performance dimensions 
similar in nature to those which have been defined in the investigations 
of individual task performance. It was hypothesized that a priori 
measurement of these dimensions and suggested group compositional 
dimensions would allow prediction of group performance in situations 
where the group activities were too complex to be evaluated in terms of 
individual performances. A research effort which had used a somewhat 
similar approach with unusual success was reported. 


was 


F. MEASUREMENT: SYSTEM PERFORMANCE MEASURES 


System Performance Measurement Objectives 


System performance measures are basically for the purpose of deter- 
mining whether mission objectives are, can be, or will be, accomplished 
by a given man-machine system. A comprehensive set of system performance 
measures describes the status of a system in a manner which will provide 
a basis for the prediction of future system status if the environment 
and external forces (stressors) are specified. In control theory, the 
set of comprehensive descriptors is called the state variables. While 
it is not expected that the theory of man-machine systems has advanced 
to the point of the analytical power possible in control theory, the 
concept of a complete set of descriptors (state variables » Or, system 
performance variables) should be quite useful. Therefore, it is this 
concept which will be used to define system performance measures. 


For current purposes, system performance measurement provides infor- 
mation about (1) accomplishment of a specified mission, or the feasibility 
of attempting the mission with a given system, (2) the shortcomings of 
the system, subsystem, or components, and (3) the margin of operation 
within safe tolerances. In short, it is desired to obtain answers to 
such questions as: Will a system do what it is expected to, or hoped to? 
If something doesn't work correctly, will the designers know what is 
wrong, and how to fix it? Is the system working within safe tolerances? 
Or, what is the probability of failure? 


In general it is possible to define measures of performance to 
answer all levels of such questions; however, it is all too often the 
case that practical measurement cannot be accomplished in the real-world 
environment. One must, therefore, fall back on predictions of the real- 
world quantities based on information collected in somewhat artificial 
environments. Even in this eventuality, the definition of performance 
measurement is not academic, for performance measurement provides a means 
for specifying prediction requirements. 


The current section on performance measurement, then, has a two-fold 
purpose: (1) to define performance measurement which is feasible in the 
operational environment, and (2) to specify requirements for performance 
prediction, i.e., to directly answer the question, "to predict what?" 
Additionally, some implications to mechanisms for prediction may be 
derived. 


For this discussion, human involvement will be treated with a strict 
systems engineering viewpoint. System performance measurement will deal 
only with the contribution of the human operators in the system to the 
system goals. Where the human contribution cannot be explicated, the 
smallest man-machine unit related to mission accomplishment will be 
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identified. Therefore, the behavioral aspects involved in task perfor- 
mance by man will largely be ignored. Nevertheless, it is definitely 
intended to provide a system performance basis to which one may construct 
a connecting bridge from behavioral analysis of the human tasks. The 
behavioral dimensions and techniques for prediction of system performance 
were treated in Chapter C. 


System Performance Dimensions 


As indicated in the foregoing, a comprehensive system performance 
measure set must include one system performance measure (as a minimum) 
for each dimension of the system which may affect performance of the 
mission designated for the system. A full specification for system 
performance measurement can therefore only be accomplished when a specific 
ease is given. However, system dimension classes may be identified which 
are believed to be inherent to all systems. 


In the subsequent paragraphs, the following levels of system per- 
formance analysis are discussed: (1) system organization, (2) functional 
descriptors, and (3) performance criteria. System organization, functional 
description and criteria constitute adequate specifications for the 
generation of system performance measurement. 


System organization. It is clear that there are performance charac- 
teristics of the entire system which may be directly related to mission 
requirements; also, there are performance characteristics related to the 
tasks performed by the human operator. However, depending on the com- 
plexity of the system there also may be many other divisions of the 
system which bear a relationship to system performance. 


To be general, one must at least postulate a hierarchical system 
structure consisting of many levels of embedded functional units, eg., 
total system, subsystems /modules/etc...components, action elements. It 
may be uncommon to find a complex system with such a clear-cut hierarchical 
structure; many system functional units may depend upon, or influence, 
many others. Consequently, the system organization may require a complex 
block diagram to display, but such a block diagram will also be required 
for other system engineering purposes. 


The system organization (block diagram) will show the flow of infor- 
mation and the chain of influence which will identify measurement points 
in the system. At each interconnection shown in a system block diagram 
something is happening which has impact on the total system. Measure- 
ment must be provided for each such point in the system in order to fully 
describe the system, and to allow diagnosis of the system. A gross 
description of the system organization will only permit gross diagnosis 
if corresponding measurement is implemented. To permit diagnosis to the 
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level of the human operators in the system, and conversely to allow prediction 
of the effect of human operators on the total system performance, system 
description must be provided down to the level of the human operator tasks. 


It is important, therefore, that the first level of analysis (system 
organization description) include all man and machine tasks, and man- 
machine, and man-man interactions to the degree of detail that one wishes 
to derive information through system performance measurement. 


Functional description. Specification of the system organization 
may indicate where measurement should take place, but no information is 
provided about what to measure. To define the dimensions of system 
performance it is necessary to have information about the functions each 
system unit is to perform. Definition of system performance dimensions 
(the second level of analysis) involves explicitly stating the function 
performed by each system unit with regard to (1) the contribution made 
to the mission objectives, (2) the nature of the required output, and 
(3) the specific impact on other system units. In this manner a chain 
of functional relationships can be established in which the effect of a 
given unit can directly or indirectly be related to the total system 
output. In particular, it is desirable for the purposes of the current 
study to show the relationship of human operator tasks to subsystem and 
total system performance (the taxonomy of tasks is treated in a 
previous chapter). 


To permit generation of system performance measures, the functional 
description of system units must be stated in operational terms. It is 
necessary to provide a description from which one can deduce the system 
variables affected and the manner in which the specified variables should 
change for proper system operation. 


Criteria specification. To complete the minimum specification for 
system performance measurement, in addition to (1) where to measure, and 
(2) what to measure, one must also know (3) what is it that should be 
learned through measurement (e.g., what kind of measure?). In short, 
one could record all the system variables (state variables) from which all 
system related information could be derived, but specific transformations 
(the mathematical relationships which define performance measurement) 
must be created for each question to be asked about the performance of 
the system. The key to the final analysis level, which establishes the 
measures for the system performance dimensional set, is to establish 
criteria for system performance variables. 


Total system output varlables may be related directly to mission 
requirements to establish criteria of performance; for example, at 
injection into orbit, vehicle velocities must be within a specifiable 
range, the vehicle must be within an altitude range, oriented in a 
specific direction (X degrees) in each axis, etc. Further, for 
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successful injection, each subsystem must be operating in a particular 
way; the astronauts must be performing certain duties, and ad infinitum. 


Based on operationally specified criteria for each performance 
variable, performance measures may be designed to provide precisely the 
information necessary to full description of system performance in terms 
of system goals. 


Performance Measurement Definition 


The structure and procedures described above to specify system 
performance orgainzation, dimensions and criteria results in a skeletal 
system model. The model does not include the internal operation of any 
of the system units but it invites one to provide all possible information 
which may have a bearing on system performance measurement. For each 
system performance measure relatable to mission objectives, answers are 
given to: Where (measurement points in the system)? What (relevant 
system variables)? To know what (operation relative to established 
criteria)? Design of performance measurement is possible based on the 
system model, but there is, unfortunately, no direct procedure to obtain 
mathematical transformations of the system dimensions to result in per- 
formance measure definitions. 


Often, system performance measurement is directly suggested by the 
performance criterion; for example, if one criterion is that less than 
X lbs. of fuel may be expended, then measurement of total fuel expended 
is an obvious choice. On the other hand, the choice is often far from 
obvious. For example, it may be desirable to exploit unforseeable 
opportunities to the benefit of ultimate mission goals; in such a case, 
it will be difficult to know what to measure and what sort of exploitation 
to expect. In short, to provide a solid basis for measurement one must 
be able to operationally define what it is that is to be found out through 
measurement, and to deal with phenomena which are reasonably well under- 
stood. The dilemma, of course, is that exploration and research efforts 
(where good measurement is vitally needed) are seldom directed at this 
sort of situation. 


Further, even if measurement is defined, it is often impossible to 
measure in the operational environment. Frequently one is unable to get 
measurement equipment into the operational situation; to do so may even 
completely change the events to be measured. As is often the case, one 
may wish to measure errors; however, to measure errors requires knowledge 
of correctness. Knowledge of correct action may be difficult to obtain, 
and if available there may even be reason to use this information to 
drastically change system design. For these and many more reasons, 
measurement in the real-world environment under operational conditions 
is only possible for the grossest of system accomplishments, or when the 
system fortuitously provides the opportunity for measurement. 
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The result is that one must attempt to predict performance instead 
of direct measurement in the operational environment to obtain the in- 
formation needed for design purposes. 


System Performance Prediction 


The prediction of the effect of out-of-tolerance performance, or 
various performance anomalies, on total system performance by any of 
the machine devices in the system is normally possible. The physical 
phenomena are sufficiently understood to permit development of a model 
which will permit direct prediction (calculation) of system performance. 
(Of course, the effect of unusual stresses, such as free-fall conditions, 
may not be tractable.) ‘The prediction of human performance is seldom 
possible at the same level; but, if the effect on human task performance 
is known in terms of the effect on machine variables, calculation of the 
same sort is possible. 


There is no need, therefore, to attempt to discover prediction 
equations which will directly predict the effects on the system of 
decrements in human performance. Prediction capabilities are available, 
in part, in the form of system models (mathematical models, or direct- 
analog simulation). If prediction techniques can be found which predict 
task performance (man or man-man) or man-machine subsystem performance, 
then these equations can be combined with the system model to provide 
a total prediction capability for predicting total system performance 
and the effect on the accomplishment of mission objectives. In taking 
this approach the validity of existing system prediction procedures 
must be accepted; even though imperfect validity is known, it is 
assumed that use of existing methods is the best short-term solution. 


The implication to human performance prediction is clear: Bridge 
the gap, by building the capability to predict system performance 
measures closely related to human tasks (e.g., the system variables 
which are directly changed as a result of human behavior), then total 
system prediction is provided (at least to the same degree of prediction 
possible for other parts of the system). Figure F-1 represents these 
relationships diagramatically. 


Measurement and Prediction Requirements for Selected Applications 


To show the range of performance measurement requirements to be 
expected in the context of an extended orbital mission, Tables Fl - Fy 
show brief analyses of selected examples. Even though these examples 
occur as part of a system, for convenience the "system" is redefined 
in each case to constitute the smallest possible ensemble of operating 
elements. As may be seen from Tables F-1 through F-4 the procedure in 
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each example is to: (1) define the system, (2) specify the system 

goals, i.e., mission requirements, (3) outline the performance measure- 
ment dimensions, (4) discuss the general characteristics of suitable 
performance measurement, and (5) identify implications for the prediction 
of human performance. 


Extra-vehicular activity.* Extra-vehicular activity (Table F-1) 
provides one of the simplest examples in terms of system complexity. The 
astronaut is required to move around and use tools, encumbered, of course, 
by his protective suit and in an environment where the result of his 
actions is quite different from the same actions on the Earth. The 
questions to be answered through measurement are concerned with the 
accomplishment of simple activities. Task measurement, except by direct 
observation, is virtually impossible without further encumbering the 
astronaut (however, biomedical data is available). For purposes of 
design (e.g., the manner of constructing and repairing an orbital labor- 
atory) , it is necessary to predict the goal-oriented measurement which 
cannot be directly measured. Note, however, that it is not sufficient 
to predict that decrements in performance are to be expected; prediction 
must address the feasibility of specific task accomplishment. 


Inflight exercise experiment. Table F-2 presents a system perfor- 
mance analysis of an inflight exercise experiment. This particular 


experiment was adapted from Gemini experiments in which the data were 
collected by means of a biomedical recorder. However, in the presumed 
shirt-sleeved environment of an extended orbital mission, such data may 
be collected by conventional means; in any case, an example is provided 
which demonstrates performance measurement requirements for an inflight 
experiment. 


The experimenter is to take blood pressure and pulse rate measure- 
ments; the rationale of the experiment is presumed that any differences 
in these measurements which appear over time, or which appear when 
compared to similar measurements before or after the flight, can be 
attributable to only the subject, not the experimenter. The experimenter 
also must control the experiment which involves pacing the subject 
through exercise. The question is: can he take these measures and 
control the experiment in a standard fashion identical to that possible 
when not stressed by the space environment? Precise requirements for 
performance measurement are again clear; also, the prediction requirements 
are well-defined (Is there any bias in the data collected, and is the 
experimental error inflated due to space stresses?). 


* Detailed task analyses, which were performed for all these examples, 
are shown in Appendix B. 
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FIGURE F-1. 


SYSTEM PERFORMANCE IMPLICATIONS 
TO HUMAN PERFORMANCE PREDICTIONS 
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Synoptic terrain photography. As may be seen from Table F-3, 


the essential elements for the conduct of synoptic terrain photography 
are few, but human performance requirements are complex. The overall 
goal is the collection of photographic information for which definitive 
criteria are difficult to establish. Otherwise, the crew must co- 
ordinate in rolling the vehicle to provide the proper views, and in 
identifying land masses. Specific task requirements may be established 
for procedures in operating the camera effectively. Prediction needs 
are primarily in terms of yes~no answers to specific questions, ie: 

Can the crew identify land masses and select pictures of high infor- 
mation content? Orient and maintain necessary vehicle attitudes? 
Operate the camera? 


Delta-V operation during rendezvous. Analysis of the change in 
velocity operation during rendezvous (Table F-4) indicates a highly 
complex system and performance measurement problem. Much more analysis 
than performed here is necessary to reveal the complete and detailed 
nature of the operation. Goals are easily established for the total 
system, but a systems analysis is necessary to show the relationship of 
specific subsystem and human performance to the accomplishment of system 
goals. Nevertheless, it is evident that accomplishment of the maneuver 
entails (1) small group activity, (2) sighting precision with optical 
devices to determine angles to particular celestial bodies, (3) orienta- 
tion of the spacecraft, and (4) man-man, man-computer and man-machine 
interaction. Prediction needs include the determination of multi-man 
task accomplishment under visual and other stressors. Overall system 
performance is not only affected by human performance, but also by the 
performance of a number of subsystems; consequently, the prediction 
equation must include a number of machine performance variables as 
well as those of human performance. 


Detailed example: Radiometry experiments. The last example is 


presented in more detail to illustrate specific performance measurement 
and prediction requirements in a complex man-machine system. To the 
extent that the literature permitted (e.g., 426), the analysis was 
accomplished according to the three levels of system performance 
analysis discussed earlier. The Tables may be found in Appendix A. 


The basic overall objectives relate to the quality and quantity of 
radiometry data collected; but, these can be assessed only after the 
recorded data can be examined by specialists. Otherwise specific per- 
formance measurement and criteria can be established for other system 
functions and human tasks. Notice that the performance measures are 
quantitative and specific (e.g., time to rotate vehicle, fuel consumed, 
pounds of fuel per unit time while tracking a target, brightness and 
contrast ratio, means and standard deviations of system variables, 
within range to ground station, etc). Notice also that some measures 
such as probability of identification require repeated measurement to 
establish reliable estimates. 
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TABLE F-1 


SYSTEM PERFORMANCE ANALYSIS 
Extra-Vehicular Activity 


System definition. The system to be considered for extra- 
vehicular activity is essentially the man, his suit, and whatever 
locomotion, tether, and tools which may be provided to hin. 


System goals. The goal is for the man to leave the vehicle, 
move from place to place and possibly perform some useful work, and 
return to either the original vehicle or some other. 


System Performance dimensions. Measurement conducted in such 
setting would be for the purposes of (1) establish that the activity 
was performed safely without any physiological ramifications (safety 
dimensions) , and (2) testing that any work performed according to 
requirements (work performance dimensions). 


Performance measurement. While the ability to actually measure 
under such circumstances is practically limited, ideally one would 
desire to monitor performance of tasks to compare with established 
margins of safety and to measure work output. With regard to the 
former, measurement should address the questions: Can the astronaut 
reach the mirror which he is supposed to put out of the way? Does 
the umbilical get near anything which might foul it? On amore goal- 
oriented basis, does he exit from the hatch without mishap? Can he 
maneuver and return within acceptable mobility, time and fuel 
limitations? With regard to the latter, measurement may address 
the questions: Can he torque the bolts as required? Can he make 
repairs? What probability can be established for getting the job 
done properly? While the measures associated with these questions 
cannot be made specific at this time, it is clear that activity 
and goal-oriented measurement could be defined. 


Performance prediction needs. Prediction is not greatly hampered 
by considerations of complex man-machine systems. One wishes to pre- 


dict simply whether man can work in such an environment or not. 
However, note that the prediction to perform work is rather specific, 
eg., can he reach a given distance in a given direction?, can he use a 
given type of tool? 
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TABLE F-2 


SYSTEM PERFORMANCE ANALYSIS 
inflight Exercise Experiment 


System definition. Presumably the system consists of the 
experimenter, a subject, and simple apparatus (Sphygmomanometer, 
exercise cord, clock). 


System goals. The goal is to conduct an experiment and to 
record the results whatever they might be. If the experiment is to 
be other than abortive, the experimenter must take periodic blood 
pressure and pulse rate measurements, while the subject must do paced 
leg-arm exercises with the exercise cord. 


System performance dimensions. The basic question should be 
whether the experiment will produce the information for which it was 
designed. Presumably, this experiment is part of a larger experiment 
in which similar data are to be collected before and after exposure 
to space conditions (i.e., before launch and after splashdown). 
Consequently, the study is based on the assumption that the dif- 
ferences noted over time are solely attributable to the space 
environment (principally free-fall conditions). Specific dimensions 
of performance include blood pressure error, pulse rate error, errors 
in experiemntal procedures. 


Performance measures. System performance measures include the 
following (assuming that any behavior on the part of the subject 
should be treated under the topic of experimental measurement) : 

(1) Experimenter performance with the blood pressure instrument 
(possible comparisons with telemetered automatic recordings); (2) 
Experimenter pulse rate performance (again, possible comparisons 
with telemetered data); (3) Experimenter control of the experiment 
(was the experiment conducted in a standard way?). 


Performance prediction needs. Predict blood pressure and pulse 
rate measurement errors by the experimenter under the stresses present. 
Unless the prediction is that no decrement in performance will result, 
the performance changes should be predicted quantitatively, as it is 
necessary to be able to estimate whether the difference will be 
practically significant (or whether a correction factor can be 
applied). Note that the task involves visual, aural, finger control, 
timing, and pacing of the subject. 
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TABLE F-3 


SYSTEM PERFORMANCE ANALYSIS 
Synoptic Terrain Photography 


System definition. The system consists of a man and a camera, 
inside a space vehicle. 


System goals. The objective is to obtain pictures of specific 
land masses. The camera, a fairly small and complex device must be 
operated in a free-fall environment. The space vehicle must be 
oriented to take pictures through a window. The land masses must be 
identified and maintained within the field of view while pictures 
are being taken. 


System performance dimensions. System performance measurement 
relates primarily to the quality of the pictures taken and the infor- 


mation content of the pictures. The man must ensure that the window 

is clean, that the subject matter is appropriate, and that the shutter/ 
lens settings are properly made in correspondence with settings that 
appear in the view finder. 


Performance measures. Proper performance on window-cleaning and 
shutter/lens setting tasks should be evident when the film is developed. 
Measurement of the orientation of the space vehicle can be provided 
through recording of vehicle attitude angles and rates (mean and 
variability about each axis should be computed). Comprehensive measure- 
ment would also include shutter/lens settings and object viewed for 
each frame of film. General mission success will be judged from the 
film after development. 


Performance prediction needs. The basic system performance pre- 
diction requirements are: (3) performance in identifying land masses 
and selecting pictures of maximum information content, (2) orientation 
of the vehicle, coordination between crew members, and maintenance of 
orientation, so that picture-taking is possible, and (3) performance 
of the visual and fine-movement tasks required to use the camera. 
Specific tolerances should be possible to define, so that the basic 
prediction task is the identification of deficiencies, if any, which 
would preclude satisfactory system performance, i.e., within tolerances. 
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TABLE F-) 


SYSTEM PERFORMANCE ANALYSIS 
Delta-V Operation During Rendezvous 


System definition. The system is quite complex, consisting of 
the vehicle, three-man crew (Apollo), navigational optics, and computer. 
The human tasks are linked and embedded with other human and machine 
actions to result in a change in the vehicle velocity vector. To 
determine the net effect of human performance, therefore, one must 
consider the performance of several people and a hierarchy of equipment, 
incorporating a system model to calculate the total effect on vehicle 
motion. 


System goals. The goal of the system is to produce a velocity 
change; a series of such changes, if adequately executed, will 
result in the rendezvous between two space vehicles. The system 
goals can be translated into goals for several subsystems; for example: 
(1) vehicle attitude must be controlled according to pre-determined 
programs within specific tolerances, (2) a computer subsystem must 
compute requirements for changes in thrust, based primarily on human 
sightings and man-sextant performance, and (3) thrusting must be con- 
trolled according to the computed program. 


System performance dimensions. Performance dimensions can be 


listed for the total system, specific subsystems, or for human tasks; 
presumably, the mathematical basis exists for interrelating all of 
these. Without performing complex systems analysis, only two levels of 
measurement are convenient for discussion: (1) total system performance, 
and (2) human navigational tasks. Total system performance is obviously 
measured in terms of the velocity vector which resulted; while perhaps 
no reference data may be available for assessment of each velocity 
changes, the number of changes to effect rendezvous and the amount of 
fuel consumed, are possible indicators of system performance. The 

basic human navigational tasks are in terms of angular measurement 
precision and time. 


Performance measurement. Several man-machine tasks can be taken 
as examples: (1) Vehicle control; (2) Sighting precision; and (3) Crew 
coordination. The vehicle must be pointed to portions of space 
permitting view of specific celestial objects, and held in that orienta- 
tion with a reasonable degree of steadiness; this is measurable in terms 
of variability of orientation angles. Sighting precision may be de- 
scribed in terms of precision and variability of centering celestial 
objects in optical devices (the basic human task) or the accuracy of 
angles entered into the computer (a man-machine output). At least one 
possible measure of crew coordination is the total time to perform a 
delta-V operation. 
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TABLE F- (Cont'd) 


Performance prediction needs. It is desirable to predict at the 
levels of system, subsystem, or human task performance. Quantitative 
prediction is necessary if total rendezvous performance prediction is 
to be attempted. The prediction equation would involve three-man crew 
performance, specific individual differences which have commonly been 
shown in sextant performance, the effect of irradiance from bright 
neighboring celestial bodies, and other space stressors. 
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Some measurement, such as the equipment set-up and operation, may 
seem trivial, but just the opposite may be true. For the Gemini V and 
VII missions, the operation of the recorder switch was apparently a 
matter of some concern. On the Gemini V mission an important measurement 
(on the rendezvous evaluation pod as it separated in space) was lost. 
The data transmitted to the ground was lost and the inflight recorder 
lacked data. Pilot error must have been suspected, as a switch guard 
on the recorder switch was added for the Gemini VII flight. However, 
further confusion was encountered as the experiment recorder operated 
intermittently during the first two revolutions of the Gemini VII 
flight. Was the loss of Gemini V dat due to improper human performance 
or equipment performance? One suspects that the answer will never be 
known. 


The transformation from a specification of the performance variables 
and the criteria to the performance measures is not one for which rules 
can be clearly established. The manner in which the criteria are phrased 
may suggest, or even stipulate a particular measure of performance; 
however, the design of performance measures is often a function of the 
available mathematical tools. If the criteria are stated in terms of 
tolerance limits, then performance measures in terms of statistical 
parameters (from which one may infer the probability of exceeding the 
tolerances) seem to be a natural choice. 


For better or worse, then, performance measures may be established; 
if required, the inventive individual with a mathematical background 
will come up with a mathematical relationship to yield quantitative 
measures. The task of implementing the resultant measures in the 
operational environment is another matter. Two problems occur regularly: 
(1) no measurement or recording devices can be installed, and (2) col- 
lection of measurement disrupts the mission (e.g., when repeated 
measures of the accomplishment of a maneuver are desired). To circum- 
vent these difficulties, scientists have been required to substitute 
prediction for direct measurement. 


Tools for System Performance Measurement 


In view of the preceding discussion it should appear natural that 
investigators would wish to create an environment more suitable to their 
purposes than the operational environment. The basic tools that have 
been used for system performance prediction are simulation devices of 
many varieties. it is very important that all who use simulators, or the 
data collected from simulation, are aware that a simulation is an analog 
of the real-world, an operating imitation of a real process. Measure- 
ments are collected from the simulation, and inferences are made about 
the real world situation. However, since the measurements are made on 
an analog, or an imitation, extrapolations to the real world must be 
viewed with suspicion. 
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Simulation devices. Since a simulation is what it is, there are 
inherently some properties of the real world not possessed by the 
simulator. The lack of some real-world properties (such as danger) may 
even be considered advantageous; or, it is asserted that specific real- 
world properties are not necessary for the intended purposes. The 
degree to which a simulator possesses necessary real-world properties 
is termed fidelity of simulation. Another classification of simulators 
may be termed level of abstraction; the simulation (or model) may 
externally possess real-world properties (i.e., there is high fidelity 
of simulation) , but it may take the form of a mathematical model rather 
than a form which looks like the real-world situation. It is frequently 
assumed (albeit, tacitly) that it is desirable to develop high fidelity, 
low abstraction, simulation devices. 


Many simulators have been used in the space program for design 
purposes, as well as for training and other purposes. Among these are 
mission simulators, part-task simulators (translation and docking 
simulator), air-bearing simulator, linear-acceleration chair, aircraft 
flying zero-g parabolas, water immersion simulator, 1/6th-g simulator, 
and many others. For the most part, these are high fidelity simulators 
attempting to produce tasks which will look just like the tasks that 
the astronauts will perform during a mission. 


Predictive validity. The majority of the simulators used in the 
space program are well-instrumented, permitting the measurement which 
would be desired in the operational environment. The degree of correla- 
tion between measures collected in the simulation and measures collected 
during operational flights is termed predictive validity. Since simula- 
tion is intended to be a substitute for measurement in the operational 
environment a basic prerequisite for the tool to be useful is for it to 
possess predictive validity. Fidelity of simulation relates to content 
validity (the extent to which real-world properties are included in the 
simulation) and does not necessarily imply predictive validity. 


Even though predictive validity is a good theoretical concept, it 
is not necessarily very practical. It should be remembered from previous 
discussion that much measurement could not be practically achieved 
during operational missions. Therefore, if one wishes to correlate with 
the operational mission events, one must correlate at the level of gross 


mission accomplishments, or rely on the subjective judgment of astronauts. 


If it is possible to predict gross system performance measures, one may 
be tempted to infer that prediction of subsystem and task performance 

are also valid. However, this is equivalent to assuming that the ability 
to predict aircraft landing performance from simulator data allows one 

to assume that predictions of performance during the approach are also 
valid (experience indicates the contrary) » 
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The space program has many instances where the characteristics of 
the simulator were changed after the mission was flown (e.g., changes 
in simulator noise and vibration after launch experience). In other 
cases, predictions from simulations were found to be invalid. The zero-g 
simulations did not predict the biomedical factors which brought about 
an early cessation of Astronaut Cernan's extravehicular task on Gemini 
IX. Correlation of water immersion simulation with Gemini EVA results 
(405) indicates (1) tasks in space were not performed in the same order, 
precluding comparison, (2) water immersion simulation may be inadequate 
for rapid motions, due to the presence of drag, (3) motions in real EVA 
resembled motions in the simulator, but time differences were noticeable, 
and (4) performance in orbit required a higher metabolic output than 
was required in the simulation, particularly for moderate or higher 
work tasks. 


Consequently, our ability to simulate must be questioned. High 
fidelity of simulation may not result in predictive validity. Nor, 
should we really expect the simulation to have the same external appear- 
ances as the real-world. Where the phenomena are reasonably well under- 
stood (e.g., wind tunnel, model boat basin) distortions are delibertely 
introduced into the model to derive predictive validity (although, wind 
tunnel and model boat basin results have also occasionally been found to 
be invalid when structural failures dramatically proved them wrong). 
Perhaps the key problem is basic understanding of the problems for which 
simulation is used as a tool. Because there is ostensibly no other way, 
it is tempting to believe the results of measurement in a simulation in 
which everything looks just like we think it should. 


Alternatives to high-fidelity simulation. It is really doubtful 
that any substitute for high-fidelity simul.ation will be found in the 


near future. A weighting of the successes and failures of simulation 
appear to overwhelmingly favor high-fidelity simulation for the design 
of complex systems. 


The current study is primarily concerned with the problems of human 
performance prediction and the relation to system performance measures. 
In this context, emphasis is placed on the behavioral content of simula- 
tion. The current study includes the investigation of the development 
of tests for the prediction of human performance in operational tasks. 
Consequently, a possible alternative to full-mission, high-fidelity 
simulation, is the prediction of system performance based on tests with 
the appropriate behavioral components. In short, predictive validity may 
conceivably be accomplished in a much more abstract way (i-e., mathe- 
matical prediction) through the use of an abstract model which satis- 
factorially represents the characteristics of the real-world operation, 
i.e., content as well as predictive validity. , 
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summary: System Performance Measures 


System performance measurement is expected to provide information 
about the accomplishment of a specified mission, the shortcomings of 
the system, and the margin of operation within safe tolerances. Analysis 
of system performance consists of three levels: (1) system organization, 
(2) functional description, and (3) performance criteria. The results 
of performing such an analysis is to provide information about the 
measurement points in the system, necessary and sufficient system vari- 
ables for measurement, and required performance relative to established 
criteria. 


Another result of such an analysis is to produce a system model 
appropriate for the specification of methods for system performance 
prediction. If prediction techniques can be found which will yield man, 
man~man, or man-machine performance, then these can be combined with the 
system model to permit a capability for total system performance pre- 
diction. Figure F-1l illustrates the relationships involved. 


An examination of a number of representative system performance 
measurement problems indicates a design need for quantitative, precise 
prediction of man-machine subsystem, and total system performance in 
a way which will permit evaluation in terms of mission requirements. The 
examples show by means of illustration that mathematical definitions of 
system performance can be defined. Even though these may be somewhat 
arbitrary and are limited by how well one can define the nature of infor- 
mation which measurement is expected to provide, they present reasonable 
targets for system performance prediction. The task of implementing 
the resultant measures in the operational environment is another matter; 
often no measurement devices can be installed in the operational vehicle, 
or, collection of measurement is not possible without disruption or 
re-definition of the mission. 


Simulation is a common form of system model which allows system 
performance measurement to be collected on an operating imitation of 
the real~world process. Inferences about the real-world situation are 
made from the simulator measurements; however, since the measures are 
collected on an analog, extrapolation to the real world must be done 
with care, €.g., Some assurance that the measurement is valid. 


A possible alternative to full-mission, high-fidelity simulation, 
is the prediction of system performance through the use of mathematical 
prediction techniques wherein the human impact on system performance is 
based on tests with the appropriate behavioral components. The point-of- 
view presented here is that the worth of a prediction method is best 
judged through tests of its predictive validity. An abstract model may 
conceivably exceed the predictive validity of a model which is a working 
imitation with a high degree of resemblance to the real world. That is, 
of course, a hypothesis which may be ultimately tested. 
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CHAPTER G. SELECTION OF TEST BATTERTES 


The present program was not designed to extract either specific test 
application recommendations or to develop particular test batteries. 
However, a number of significant points may be made about the critical 
variables and the methodological approach to test battery development. 


The Problem of Dimensions 


In the practical sense, the number of testable dimensions implied 
by an application of the present methodology may become very large, so 
large in fact that feasible testing programs may be in serious doubt. 

In short, the complexity of the behavior and the number of dimensions 
involved in the behavior may be such that test batteries constructed to 
obtain precise information about each of the dimensions simply may not be 
within the range of any practical application. 


For example, in Chapters C and D, the published literature was used 
to extract some 75 possible dimensions that may appear in human performance 
in man-machine systems. Precise test measurement of 75 dimensions would 
most probably- if they should occur in each specific application- present 
a testing program beyond any reasonable bounds of resources that could be 
allocated to a testing program per se. 


A specific example may be found in Appendix A where the prediction 
methodology developed here has been applied to the celestial and radiometry 
experiments derived from the Gemini V and Gemini VII missions. For that 
relatively simple task, 19 dimensions are identified in the task perfor- 
mance of the commander pilot and copilot. A complete test battery suffi- 
cient for these dimensions would involve a set of 17 tests. ‘That number 
alone brings into question feasibility of measurement; if the method was 
replicated across all the tasks involved in the Extended Earth Orbital 
Laboratory the number of test batteries each with multiple dimensions would 
clearly be beyond any practical scope. 


Immediate relief, however, is found simply in the redundancy of 
dimensions that will occur across tasks. Analysis across tasks should 
show the relative frequency of the appearance of dimensions for all task 
components and imply the relative importance of the dimensions for the 
entire task set. Expert judgment, based on the specific problem at hand, 
is necessary to decide which parameters must be measured and which 
parameters simply do not constitute a significantly large portion of the 
variance to justify measurement. 


The Bandwidth-Fidelity Dilemma 


From the standpoint of test and measurement theory, Cronbach and 
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Gleser (125) have elaborated a testing program which seems very appropriate 
to the problem of multiple-dimensions and test battery design. They note 
that, within the bounds of feasible cost and testing time, there is 
inevitably a conflict between the variety of information desired (the test 
battery “bandwidth") and the thoroughness with which each dimension is 
measured (test "fidelity"). Traditional testing techniques would suggest 
that the maximim possible precision of measurement should be obtained for 
each dimension; practical consideration dictates that on this basis only 
a relatively few number of dimensions can be measured while the remainder 
will simply not be measured at all. 


Cronbach and Gleser (125, pp. 97-107) clearly show that this is not 
the appropriate approach for complex multiple-decision test situations. 
For particular problems, the optimal strategy for testing is a compromise 
between the range of testing ("bandwidth") and the precision of testing 
("fidelity"). While the test theory is complex, three of their general 
conclusions may be noted as guidelines for the present problem: 


1. Within a finite limit of reasonable test time, several tests 
are better than a single test even at some cost in single dimension 
validity. The critical emphasis is not on the precision With which one 
test measures one dimension but rather the relative importance of each 
test to all the dimensions involved in the prediction problem. In 
practice, this implies a set of several tests each of which may have 
relatively low validity measures but which, in combination, provide 
far more useful overall information as compared with a single precise test 
that measures one dimension well but excludes any measurement on the rest 
of the dimensions in the problem. 


In complex, multi-dimensional, decision situations, therefore, the 
traditional emphasis on single test validity coefficients is misguided. 
The cost of achieving high single dimension validity will probably be the 
loss of most of the pertinent information desired. 


2. Not all dimensions must be measured. Again, within a finite 
practical limit of reasonable test time, equal testing time for all 
dimensions is not necessarily optimal. The range of the test battery 
("bandwidth") may well be best limited particularly if the relative 
importance of the dimensions vary. 


3. "For any given problem there is an optimal distribution of effort, 
poth with respect to number of tests to be given and amount of time to be 
devoted to each test" (125, p. 106). The achievement of this "optimal 
distribution" for human performance prediction in man-machine systems is 
@ very complex problem; no techniques exist in the present man-machine 
systems literature to solve this problem; indeed, it has been totally 
ignored. 
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Development of a Generalized Test Battery 


There has been much interest over the past decade in this literature, 
and particularly over the past five years, in the development of general 
test batteries for a wide range of man-machine system applications within 
simulated and operational environments. It does not seem too much of an 
exaggeration to state that the "normal" procedure for test development has 
involved three steps: (1) select or invent some test or a small set of 
tests which have intrinsic interest for subject execution and superficially 
assumed face validity, (2) demonstrate that the test(s) are sensitive to 
(i.e., produce some performance changes) in the presence of stressors (any 
stressor is satisfactory), and (3) concentrate on the engineering 
characteristics of the test device or test panel to insure that a compact 
and portable piece of equipment is developed. While there are some few 
significant exceptions to this procedure, in general it seems to have been 
the mode of operation in the literature. It is little wonder that there 
has been increasing suspicion about the usefulness, validity, and meaning 
of the "test approach” in human performance prediction. 


However, it seems very possible that effective test devices and 
methods can be developed for human performance prediction in man-machine 
systems provided certain basic steps are taken: 


Ll. We must understand far more thoroughly the behavior we are 
attempting to measure. In classical applications, the degree of predictive 
success has been a direct function of the detailed understanding of the 
behavior being measured. Superficial estimates of face validity is simply 
not adequate. It is for this reason that so much attention has been given 
here (cf., Chapters B and C) to what corresponds to classical job analysis. 


A generalized test battery must be particularly tuned to the most 
critical dimensions of the behavior involved. Yet, in only two cases in 
this entire literature has there been serious attempts to establish this 
relationship in developing a test battery, one in the case of manned 
space vehicle tasks (190) and one in the case of underwater tasks (372). 


2. Certain basic steps of test development cannot be ignored. We 
must insist on quantitative measurement of test reliability. While in 
some cases this requirement is amply fulfilled in the majority of studies 
it is simply ignored. 


3. We must be able to show how basic human properties are quantita- 
tively related to human task performance and in turn to system performance. 
Much attention has been given here to this problem (cf., Chapters A and F), 
and there is little question as to the magnitude of this undertaking (and 
no question as to how far we are from significant achievements.) 


4. The development of useful, precise, valid, reliable, and practical 
test batteries is not a simple, inexpensive, process. Those tests in the 
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general psychological literature which have approached these criteria 
(e.g., the MMPI) are the result of years of careful development. 


Constraints on Test Development 


The difficulty of developing tests and test batteries for human 
performance prediction in man-machine systems is further complicated by 
both familiar and unique constraints all of which seem to be accentuated 
relative to test application situations. Some of these are: 


Predictive validity. The best technique of test validation remains 
the measurement of predictive validity. Yet, in many man-machine system 
problems, predictive validity measures are simply not possible. 

"Face" validity. Far too much emphasis is placed on face validity. 
In far too many cases, "face" validity involves a superficial judgment 
that the test samples the task environment; in short, face validity is 
often used as a poor representation- or claim- of content validity. Yet, 
rarely are we told in detail the basis upon which this claim is made. 


Training time. Minimization of training time for tests is a standard 
requirement in all testing applications. Yet, in the present literature 
this appears often to become an end in itself. Relative to the training 
requirements integral to most man-machine system tasks, minimum test 
training time can only be achieved by radical distortion and oversimplifi- 
cation of the test- in which case all validity may be lost. 


Testing time. There would appear to be an overemphasis on minimization 
of testing time. The consequences of this trend are often to reduce test 
length to a point where validity is no longer possible. It is true that 
utility analysis (125) suggests tradeoffs between test length, test numbers, 
and range of decisions, but there is a point beyond which the test becomes 
useless in any context. 


Repeated applications. For many man-machine systems applications, 
there is a requirement for repeated application of tests over extended 
periods of time introducing potential artifacts of learning and boredom. 
One classical solution- equivalent forms- has not been adequately 
exploited in the present literature. 


Test motivation. There have been several recent cases where subjects 
in man-machine system experiments involving tests have simply refused to 
do the tests after a period of time. The requirement has been stated 
that tests must be made "interesting" and "motivating" to the subjects. 
That requirement is not easily achieved. One suspected difficulty is that 
subjects inthese experiments are often required to perform tests without 
any understanding of why the tests are being given. Perhaps better 
instruction to subjects as to the relevance of the test program might 
alleviate many of the motivational problems. 


118 


Three major problems dominate the literature on human performance 
prediction tests in man-machine system performance: first, elementary 
and essential rules in test development have been frequently ignored; 
second, modern techniques for the development of cost-effective tests 
and test batteries through utility analysis have not been used; and, 
third, the basic issues in test validity have been avoided. So long as 
this "strategy" continues, the literature will be extremely suspect. 
However, all of these difficulties can be resolved. 
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APPENDIX A 


An Application of the Human Performance 
Prediction Methodology 


The purpose of the exercise of the human performance prediction 
methodology presented in this appendix was to provide demonstrations of 
how this methodology would be applied to a specific man-machine system 
activity: the celestial and radiometry experiments conducted during the 
Gemini V and Gemini VII missions. It will be seen that the series of 
events and the levels of analysis are such that they provide the necessary 
answers to the four questions which must be answered adequately if the 
performance of the man or the man-machine system is to be predicted with 
optimal effectiveness: 


1. To predict what? 
2. Upon what dimensions and measures? 
3. With what tools? 
4, For what purpose? 


The sections following represent the actual output 
of efforts directed toward the above questions using the framework and 
methods specified in the text. Each of these sections is discussed 
beLow in terms of what particular purpose they serve and what aspect of 
the technical approach they illustrate. 


Mission Task Analysis Detailed function and time-line analyses of a 
task-descriptive nature were performed for several mission segments to 
afford an overview from which initial selections for further analysis 
could be made. Figure AA-1 presents the analysis which had been performed 
for the celestial am space-object radiometry experiements. Although the 
overall task analysis may use a different format or level of detail than 
this particular example, it should serve to effectively guide the initial 
quest for gross-level answers to the question, "To predict what?" In 
this case, a review of the several analyses (see Appendix B) pointed to the 
radiometry experiments as being a particularly fruitful segment for 
methodology demonstration purposes. 


Chapter B of the text discusses the use of task analysis in 
further detail, and the technique used in generating Figure AA-1. 


Description of System Operation, or the Group Level Analysis A man-man, 
man-machine interaction form of task analysis was used to delineate the 
ongoing man and system activities during the radiometry experiments (Tables 
AA-1 & AA-2). This is an extremely important step as it is this level of 
analysis, system description at the level of human operator tasks, which: 
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1. Provides the basis for the establishment of the system organi- 
zation, function description and the performance criteria and 
performance measures as listed in Table AA-3. 


2. Sets the stage for the individual level analysis on tasks 1 
through 19 in that: 


a. the man-man interactions are delineated and related to the 
operator input to the system, and 


bo the man-machine interactions and, therefore, interface are 
identified. 


3. Identifies the behaviors in a manner which: 


a. facilitates the location of those points most sensitive to 
stressors due to the nature of the task and the task relation 
ship to system performance. 


be facilitates the identification of the task sets for and 
their functional relationship to (e.g., parallel, series, 
etc.) system performance measures. 


The methodology which is represented by Tables AA-1 and AA-2 is discussed 
from the systems viewpoint in Chapter F and from the human operator 
viewpoint in Chapter B. What is obtained in Tables AA-1 and AA-2 is the 
description necessary to arrive at the system and human performance 
dimensions necessary to answer the question, "To predict what?" in full. 


System Level Analysis As detailed in Chapter F of the text, Table AA-~3 
tabulates the results of three levels of system performance analysis: 
organization of the system into appropriate categories, description of 
the functions and the related tasks for each category, and definition 

of the performance criteria, or dimensions, to access the satisfactory 
fulfillment of the described functions. ‘The contents of the criteria 
column represent the answers, in final form, to the question, "To predict 
what?", from the system performance standpoint as it concerns the human 
operator. The fourth column presents the end product of the analyses, a 
specified set of man-machine system performance measures. These perfor- 
mance measures provide an exact answer to the question, "Upon what 
measures?", from the system performance standpoint and identify the nature 
of the criteria and measures from the human performance standpoint. ‘The 
fifth column contains a listing of alpha characters to allow reference 
to the performance measures in later tables. 
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FIGURE AA-1. The mission task analysis for the Celestial 
and Space~Object Radiometry Experiments 
presents a detailed function and time-line 
analysis for that mission segment. 
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align Pulse to align cally 
sens- jets vehicle sighting 
ing on properly on 
units proper target. 
with side 
target to 

rotate 

craft. 


Turn Tac- Dis-  High- 2 Performed. 


Reariee tile crete other - in 
meter = - switches 5 Zero-G 
Power Fine Indi- are in Sec. 
ON Motor vi- aproximity 
Push gual to this 
power and must 
switch be 
ah inte avoided. 


position 


FEEDBACK TASK CONTEXT 


Criteria 
of 
Correct 


Number 


Task 


Failure Time 


Embedding Structuring Consequence Sharing 


Performance Modality Content Duration Personnel 


Visually Direct - Visual-~ Remains 2 Part of Part of 
observe doors Doors can Experi- off Observa- Experiment Checklist 
blown off of be seen to menter through- tion by Procedure 
Radiometry explode sees out 2 person- 
area. from doors Mission nel pro- 
vehicle ejected. vides 
side. verifi- 
cation of 
ejection. 
Visually Direct - Visual - Remains 2 Part of Part of 
observe Sensing Experi- in experiment Checklist 
sensing devices menter extended procedure 
devices can be can see position 
rising out observed sensing for 
of space- extending devices remainder 
'eraft. out of erect. of 
side of mission. 
spacecraft. 
Optical Direct-, Visual- Remains 2 Part of Part of 
sights target Experi- in Close experiment checklist 
aligned appears menter this posi- coordina- procedure 
with in sights tion until tion 
proper center target another necessary 
target of in experiment for 
optical center requires proper 
sight. of change. align- 
sight. ment. 
Visually Direct- Visual- Remains J. Part of Part of 
observe experi- Tactile in experiment checklist 
switch menter Switch up position procedure o 
moved to can see can be during 
"up" position.switch seen and this 
is up. felt to experiment. 


move into 


position. 
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Celestial Voice 
Radiometry Comm. 
Experiment with 

could not Grnd. 

be 

completed. 


Celestial Report 
Radiometry to 
experiment Grnd 


could not station 

be when 

completed. com- 
pleted. 


Celestial Voice 


Radiometry comm. 
experiment with 
could not experi- 
be menter 
completed. at 
optical 
sight. 
Celestial None 
Radiometry 
experiment 
could not be 
completed. 


BEHAVIOR: 
Infor- 


Charact- mation 
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RESPONSE REQUIREMENTS 


Accuracy Time Stress 


Type Mechanism eristics Presented Duration No. Content Type No. Req. Req. Factors 


Check Visual Dis- High- 5 Performed 
Amumeter crete if - in 
for - Ammeter 10 Zero-G 
proper In- reading Sec. condition 
reading. divi- not 
dual within 
bounds 
power 
should 
be 
turned 
off. 
Turn Tac- Ser- High 5 Performed 
on tile ial - in 
Recorder - - 10 Zero-G 
Fine mul- Sec. Condition 
Motor tiple 
Lift 
Guard 
and 
put 
record- 
er 
switch 
in On 
posi» 
tion. 
Trans- Tac- Ser- High- 2 #£Performed 
mit tile ial other - in 
Data to - - switches 5 Zero-G 
Ground Fine Mul- are in Sec. Condition 
Station Motor tiple proxi- 
(Turn Push mity 
on XMITR to this 
trans- button switch 
mitter) to up and 
posi~ must be 
tion. avoided, 
Realign 
craft to 
new 
target and 
continue 
recording 
& transmit- 
ting data. 


FEEDBACK 
Criteria 
of 


Correct 
Performance 


Visually 
observe 
the 
reading 
on the 
Ammeter 
dial to 
be within 
limits. 


Visually 
observe 
recorder 
switch 
in On 
position. 


switch 
moves to 
On 
position. 


Modality Content 


Direct~ 
Ammeter 
dial 
rotates 
and 
settles 
within 
proper 
limits. 


Direct- 
Experi- 
mentor 
can see 
switch 
is up. 


Direct=- 
Experi- 
menter 
can see 
switch 


iS Upe 


Visual- 
Experi- 
menter 
views 
Ammeter 
dial 
setting 
within 
limits. 


Visual- 
Tactile- 
Switch 
can be 
seen 

and felt 
to move 
into up 
position. 


Visual~ 
Tactile- 
switch 
can be 
seen and 
felt to 
move 
into up' 
position. 


Number Task Failure Time 
Duration Personnel Embedding Structuring Consequence Sharing 
Ammeter 1 Part of Part of Celestial None 
dial experiment Checklist. Radiometry 
registers procedure. experiment 
proper could 
reading not be 
through- completed. 
out 
experi- 
ment. 
Through- 1 Part of Part of None- data None 
out experiment Checklist will not be 
experi-~ procedure « recorded in 
ment. spacecraft 
but can 
still be 
transmitted 
to earth. 
Through~ Part of Part of If recorder Voice 
out experiment Checklist. not working comm. 
experi- procedure. then data with 
ment. will be grnd.e 
lost- if 


1e7 


TASK CONTEXT 


recorder is 
working no 
problem. 


TABLE AA-1 


SYSTEM PERFORMANCE ANALYSIS 
Celestial and Space-Object Radiometry Experiments 


Space definition: The system for these experiments consists of: 
the space vehicle, radiometry equipment, a vehicle~controller, and an 
experimenter. 


System goals: The system objective is to acquire data from 
celestial objects through sensing units fixed to the vehicle and 
record/transmit data to ground stations. Data from a number of 
specific celestial objects are desired. The sensing units must be 
directed by rotating the vehicle; targets must be identified and aligned 
visually. One man rotates and aims the vehicle; the other operates 
radiometry equipment; both are involved in target engagement. 


System performance dimensions: The basic measurement relates to 
the quality and quantity of the data collected. Were data collected on 
the desired targets? Was the vehicle sufficiently stable and within 
sighting tolerances for each target? Were all switches properly set, 
and all systems properly functioning? 


Performance measures: Aside from proper experiment set-up and 
functioning of electronic devices, key performance factors are (1) 
the identification of desired targets, and (2) the two-man vehicle- 
orientation task. In short, it would be desirable to measure such 
parameters as the designation of the target sighted, and the accuracy 
of sighting (a sighting tolerance should be specifiable which will 
ensure data quality. It is not at all clear whether from such measures 
it can be shown that decrement will probably result in out-of- 
tolerance performance. 
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DESCRIPTION OF SYSTEM OPERATION 
CELESTIAL & SPACE-OBJECT RADIOMETRY (GEMINI V & VII) 


SYSTEM 


| TASK | COMMANDER PILOT PILOT 


Spacecraft in 


orbit. 


Doors opened 


pyrotechnically. 
Three sensing 
units swing out 
in boresight 
alignment with 
optical sight 


Begin 
Jettison protectiv 
doors 
G) turn collimated 
window reticle 
light ON 
Set up 
radio- 


PERFORMANCE 
MEASUREMENT 
COMMENTS 


First revolution 
only. 


Operational 
readiness made on 
first revolution, 
not shown here 


Cryogenic IR measure- 
ments must be made 
during first 8 hours, 
measure smaller seg- 
ment of JR spectrum. 


(Set up OK?) 


equip- from mission plan 
ment Select IR sensor Either cryogenic 
type IR or IR 
(6) Radiometer power Sensors operating 
ON current flow 
indicated on 
(7 Check ammeter meter 
8 If target is star 
locate on charts; 
otherwise locate 
Rotate objects in space, 
vehicle on earth, moon. 
and Use 3-axis hand 
find controller to @O aia orientation Reaction motors 
target aim at approx. operate 


location 


Identify target by Identify target by 
looking thru window | looking thru window 


(Find correct 
target?) 


G6) should be alert 
for targets of 
opportunity 


(Find any?) 


(2) turn transmitter 


Gi) Accurately sight 
ON (photo cover- 


target with 

window reticle 
(for some tgts, 
vehicle is rota- 
ted at slow rate 
to scan across 


target area) 


Verify reception 
by ground 
station 


FM signals trans- 


ing station 


3) Hola aim 


Transmit (5) Voice commentary (voice commentary 
and 


6.4) Turn recorder ON 


€) turn recorder OFF 


TABLE AA-2. 


numbered for later reference. 129 


The operation of the man-machine system 
experiments during the Gemini V and VII flights is described. 


Signals recorded 


Sensor field-of-view 
@ 50 


age also possible)} mitted to track-| Sensor misalignment 


¥ ie 
Aiming accuracy € 3° 
(Aiming within 
tolerances?) 
Amount of fuel used? 


Recording data impor- 
tant only when not 
transmitting to a 
ground station 


Voice to be related 
to data 


56 minutes of record- 
ing possible 
(Judicious use of 
recording time?) 
(Were data collected? 


immediately concerned with the radiometry 


The tasks are 


CELESTIAT, AND SPACH-ORBIT RADTOMETRY EXPERIMENTS 


SYSTEM LEVEL ANALYSIS 


SYSTEM FUNCTION/ TASK PERFORMANCE ALPHA 
ORGANIZATION DESCRIPTION CRITERTA MEASURES CODE 
VEHICLE Functions: 
GUIDANCE I. Rotate vehicle to |Time (target within Time Between: (1) 
AND CONTROL fassist scanning for reticle) & T,, start sean, (2) 
target object (and tgt within reticle 
Command-pilot[scanning of target Fuel (target within 
G & C System |with sensors) reticle) 2F bs. Fuel consumed 


Optical sight a 


II. Maintain align- Mean & std. dev. of 
ment of target with Angular error & 39 misalignment error 
window reticle 


Tasks: 
1. Rotate vehicle with] Angular velocity: of 
reaction motors using | YMin.& VRot.< Vax. 
3-axis hand controller|Minimum control actua4No. control 
tions inputs 


2. Small adjustments For each adjustment: Lbs. Fuel for 
of vehicle orienta- AfFuel < Ba Unit time Tracking 
tion with hand con- 
troller Stick Movement € @s, [Mean & std. Dev. of 
Minimum stick movement jcontrolled displace- 
ment 


[stick deflections|dt 


3. Control reticle: For tgt loc. & ident. 
on/off brightness Bret SBoptimum Bret-Bbkgrnd _ 
Bbkernd = Ratio 


RADIOMETRY Functions: 

DATA I. Set-up & checkout | Data transmitted and/ |Examination of data 

COLLECTION of radiometry equip. or recorded (as appro-|by radiometry spe- 
priate) for all tgts. |cialist 


Pilot II. Collect data ap- [Appropriate data col- |JExamination of- data 
Sensors propriate to each tgt.| lection for all tgts. |by radiometry spe- 
Transmitters cialist 
Tape Record- | Tasks: 
ers 1. Deploy equipment Equip. deployed Verbal report of 
Control Panel]2. Select equip. con- | Cryogenic for first 8 |Cryogenic power on 
figuration hours . ( recording) 
3. Operate transmitter Transmit in range of Transmitter power vs. 
grnd. station Range of time (re- 
cordings) 
4. Operate tape re- Tape all data, €56 |Tape examination by 
corder min. specialists. 
Tape power on 
(recording). 
5. Detect equipment No. min. of data 
malfunction collected 
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CELESTIAL AND SPACE-ORBIT RADIOMETRY EXPERIMENTS 


SYSTEM LEVEL ANALYSIS (Continued) 


SYSTEM FUNCTION/ TASK PERFORMANCE ALPHA 
ORGANIZATION DESCRIPTION CRI TERTA MEASURES CODE 
III. TARGET Functions: 
LOCATION I. Visually locate Required sequence: Verbal recording 
AND IDENTI- |[tgts according to tgt,, tgte, tgtz...., Janalysis of data 
FICATION mission plan tgty 
Both pilots {II. Find tgets. of No. tgts. opportunity |Count based on ver- 
Windows opportunity 20 bal recording, 
Charts analysis of data 
Tasks: 
1. Locate on charts scan time (tgt. in Time from (1) start 
@. Control reticle reticle) 4 Ty, scan, to (2) tgt 
brightness within reticle 
3. Scan (rotate vehi- 
cle) for select- |Prob. ices P% No. tgts detected X10 
ed targets : No. possible tgts 


4, Identify targets 
of opportunity 


TABLE AA-3. A system level analysis is performed to identify the 
system performance measurement set. The performance 
measures are given alpha designations for later reference. 
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System-Task Performance Relationship Table AA- presents a listing of 
the system performance measures with the associated task sets. An 
associated operator task was defined as one the performance of which 

had a determining influence on whether, or how well, the system criterion 
was met. Table AA-) is of special importance as it represents the estab- 
lishment of the relationships between system performance and operator 
performance; for example: 


Let t; be task performance i, and 


yi be system performance measure i. 


if Vg = Contrast ratio, a system performance measure from Table AA-3. 
t), = Turn collimated window reticle light on, task 4 from Table AA-2. 
and t5 = Adjust brightness of the reticle light, task 5 from Table AA-2. 


(1) then yg = f(ty, ts) 


The nature of the transformation of the task performances to the system 
performances is rarely defined easily; although in the above example it 
can be-seen that the measure Y, is dependent on t) if it is to be met 
at all and is dependent on ts “for the "goodness" with which it is met. 
The success of the transformation definition will be largely determined 
by the clarity and adequacy of the definition of the system and task 
performance criteria. What is being demonstrated here, however, is the 
essential first step: the specification of the existing functional 
relationships. 


individual Operator Level of Analysis The individual level analysis 


represented by Table AA~Dis discussed in detail in Chapters C 

and D of the text. The table presents the mapping of human performance 
dimension to the enumerated tasks of Table AA-2, using the input-processing-~ 
output paradigm. 


During the early development stages of advanced systems, the adequacy 
of the mapping activity may be limited by the lack of detailed information. 
Any information that can be obtained pertinent to the items below should, 
however, be collected. The information collected or generated for the 
radiometry experiments pertinent to these items was as follows: 


1) The nature of the task performance measure. The task performance 


Measures were, in this case, considered to be primarily defined 

in terms of the system performance measures as listed in Table AA-3,. 
Additional dimensions were selected in some cases for possible 
other criteria, such as speed. 
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2) The background characteristics of the operators. ‘The men were 


described as mature with pilot backgrounds. 


3) The surrounding conditions. A review of the static, physical 
task enviroment may suggest that certain dimensions will be 
emphasized in the performance (e.g., panel layout, display 
characteristics, etc.). The task environment within Gemini V 
and VII was well described (cf. 426) and is presented in Figure 
AA-2. For the variable parameters, two conditions were con- 
sidered: a) normal, standard operating conditions and b) stress 
conditions, a variety of which were evaluated. The primary 
dimensional set was identified under condition (a) with 
additional dimensions selected for (b). 


4) The skill level of the operators. Two levels were considered: 
a) skilled and b) relatively unskilled. (a) was evaluated in 
conjunction with 3(a) above. Additional dimensions were selected 
for level (b) items. 


The mapping for (b) of the skill and surrounding conditions above 
was done on tasks 9 and 10 only. Although the beta loadings on the other 
tasks would also be affected, tasks 9 and 10 were pinpointed for the 
following reasons: 1) the effective use of fuel is critical to the over- 
all mission success, 2) the measure on task 9, in particular, would be 
relatively sensitive to performance variations and is known to be 
differentially predicted by dimensions as a function of learning, and 
3) it appeared to be the most critical point with respect to team inter- 
action and, therefore, possibly more stress and learning sensitive. 


The purpose of the above activities was to provide answers to the 
question, “Upon what measures?" from the human behavioral standpoint, in 
the form of sociopsychological dimensions, here called human performance 
dimensions. Once these have abeen listed, then: 1) an overall predictive 
relationship is established and 2) it is possible to proceed to the 
third question from the man standpoint, "With what tools?". The overall 
predictive relationship concerns system performance and is as follows: 


Let xy be human performance dimension i. 
If ty i f(x,, Xo» eo0y Xi» eony x) 


f( 6, 36, Aiming) (See Table AA-5) 


or ty 
and ts = #[:7 (brightness discrimination) (See Table AA-5) 
then from (1): 


Ye = e[56, 36, Aiming, 47 (brightness discrimination)] 
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MATCHING SYSTEM PERFORMANCE MEASURES TO THE TASK ANALYSIS SUCH THAT: 
SYSTEM PERFORMANCEn man ~= £(MAN-MAN, MAN-MACHINE INTRRACTIONS) 


SYSTEM PERFORMANCE MEASURES MAN-MAN, MAN-MACHINE INTERACTIONS 
(alphas from Table AA-3) (numbers from Table AA-2) 


I. Guidance and Control 
a, Cy J 4, 5, 9, 10 
by eget 11 (target scanning only) 13 


& 4,5 


IL. Radiometry Data Collections 
h Lip Oy Pole Wy LF 
i Le 2p Batby Ts Cee ay 1-56 
1 
3 
12, 14 


TA Jb 6y Le 


IIT. Target location 
n 2 
oO 18, 19 
4, 5, 9, 10 
4, 5, 8, 9, 10 


TABLE AA-k, System performance measures which are a function of human 
activity are matched to specific task performances by the 


crew members. 
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CELESTIAL AND SPACE-OBJECT RADIOMETRY EXPERIMENTS 


INDIVIDUAL OPERATOR LEVEL OF ANALYSIS 


TABLE AA-5 (a) 
SKILLED PERSONNEL, STANDARD OPERATING PROCEDURE 


COMMANDER PILOT PILOT 
Human Performance Dimensions Taskg Human Performance Dimensions 


56, 36, aiming .| 56, 36, aiming 


47 (brightness discrimination) - | 48, 19, 75 (conscientious) 


57 
56, 36 


57, 75 (carefulness) 


47 (dynamic visual acuity), 48, 55 


49, 60, 50, 54, 36, 37, 71 
47 (dynamic visual acuity), 
(Hand controller assumed to 60, 50, 54, 20 
allow continuous Av opera- 
tion with automatic null in 
neutral position) 


By 865 aiming 


54, 36, 37, 71 aiming 


49, 20, 28, 75 (conscientious, 15 (conscientious, 
practical) practical) 


aiming 
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TABLE AA-5(b). STRESSFUL CONDITIONS 


(low fuel or other condition creating doubt as to 
advisibility or feasibility of completion or 
continuance; fatigue; monotony) 


COMMANDER PILOT PILOT 
Tasks Human Performance Dimensions Human Performance Dimensions 


57, 75 (carefulness) 


71, Th, 75, 24, 73 


specific dimensions selected would be a function of 
the specific situation. Other tasks, for example task 
no. 14, may also be affected. 


TABLE AA-5(c) 


RELATIVELY UNSKILLED PERSONNEL, INITTAL PERFORMANCES 


COMMANDER PILOT PILOT 
Human Performance Dimensions Human Performance Dimensions 


28 7 235: 56,9595 Tas THs 75 ; Bix 20 239. 20y Fone Ts. 1D 


(59 may be in effect 
throughout the entire 
task sequence) 


TABLE AA-5. Human performance dimensions (numerically 
identified in the same manner as presented 
in Chapters C and D) are mapped to the crew 
member activities (numerically identified 
in the same manner as in Table AA-2), for 
three man-man, man-machine interaction states 
as defined by skill and stress levels. 
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€ Yaw axis 


Sm Yow right 
/ 7 27 Communications 
Yaw left a buttons 
eee ak Pa 


_ Palm pivot 
Z(G Pitch axis) 


Pitch up 


Pitch down 


Roll left 


Se right 


¢ Roll axis 


Fig. AA-2(a). Command pilot's panel. Fig. AA-2(b). Altitude hand control 
operated by command pilot. 


| =e 
oH 
a 


Fig. AA-2(c). Crew station arrangement. Fig. AA-2(d). Pilot's panel. 
The critical interfaces are shaded. 


FIGURE AA-2. Man-machine interface for the radiometry experiments conducted 
in Gemini V and Gemini VII. (Figures taken from reference 426.) 
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However, since the definition of y, does not emphasize the possible 
time or accuracy requirements for 2h, the relationship then becomes: 


(2) Yg = 1£(56, 47(Brightness discrimination) ) 


As mentioned above, the selection of the sociopsychological dimensions 
predictive of operator and, therefore, system performance is a major step 
towards deriving an answer to the third question, "With what tools?" 
Which tools are selected will, of course, also be contingent on the purpose 
(the fourth question) the tools must serve: human performance prediction 


Test Battery Development. Prior to the selection of any test or test 
battery for human performance prediction, a basic decision must be made 
as to the appropriate test strategy. In the case of a single scientific 
experiment such as celestial and space-object radiometry and with the 
system equipment (Figure AA-2) available and tasks and system performance 
requirements specified (Tables AA-2 and AA-3), the logical test strategy 
is a direct test in an operationally simulated environment. 


However, this example serves as an illustrative case of the selection 
of tests and test batteries once the sociopsychological dimensions have 
been related to system and task performance. From Table AA-5, it may be 
seen that some 19 dimensions have been identified*. These have been 
re-grouped and named in Table AA-6, and associated with the commander 
pilot and copilot. 


Table AA-7 shows that 11 of the dimensions are common to both crew 
members; and four each are unique. It is obvious that a separate test 
battery is not required for each crew member. 


From the tabulation of Table AA-7, it is possible to identify test 
candidates. Here, Volume II is indispensible for the appropriate selec-~ 
tion of a dimensional test for each dimension. Several criteria have 
been used to select the test candidates in Table AA-7. They include: 

(1) validity of measurement, (2) simplicity of test, (3) ease of adminis- 

tration, (4) demonstrated use with operational personnel comparable to 

those in this example, (5) sensitivity to stressors based on the existing 
literature, and (6) tests which measure multiple dimensions. Wherever 
possible, potential interest was considered; for example, "Spatial Orien- 
tation IE" involves the use of aerial navigation maps. 

* For those who advocate simplistic task taxonomies the multi-dimensionality 
of this relatively simple operational task will be abhorent. Be that as 
it may, detailed analysis of man-machine systems tasks (cf., 190, 372) 
invariably results in one conclusion: human performance in man-machine 
system tasks is complex. 
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TABLE AA-6 


CELESTIAL AND SPACEH-OBJECT RADIOMETRY: 
SOCIOPSYCHOLOGICAL DIMENSIONS 


DIMENSION COMMANDER PILOT NAME 

19 x Verbal Knowledge 

20 x x Word Fluency 

28 Xx xX Logical Evaluation 

36 x xX Response Orientation 

37 xX Control Precision 

WT xX x Dynamic Visual Acuity 

LT x Brightness Discrimination 

48 x Perceptual Speed 

hg x Time Sharing 

50 xX x Closure Abilities 

5h xX xX Spatial Orientation 

55 x Spatial Visualization 

56 x x Associate Memory: Rote 

57 x Associate Memory: Meaningful 

60 X x Visual Memory 

wie) x x Flexibility: Rigidity 
Reaction 

71 x Self Control Reaction 

74 x x Desired Level of Output 

75 x x Desired Type of Output 

Aiming xX xX Aiming 
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TABLE AA-7 


CELESTIAL AND SPACE-OBJECT RADIOMETRY: 


SOCLTOPSYCHOLOGICAL DIMENSIONS AND TEST CANDIDATES 


COMMON DIMENSIONS 


Commander & Pilot 


TNDIVIDUAL DIMENSIONS 
Commander Pilot 


* Also measures 


DIMENSION NAME 


Word Fluency 
Logical Evaluation 
Response Orientation 


Dynamic Visual Acuity 


Closure Abilities 


Spatial Orientation 
Associate Memory: Rote 
Visual Memory 

Desired Level of Output 


Desired Type Of Output 
Aiming 


Verbal Knowledge 
Control Precision 
Brightness Discrimination 


Perceptual Speed 
Time Sharing 


Spatial Visualization 
Assoc. Mem.: Meaningful 
Self Control: Reaction 


TEST CANDIDATE 


Word Arrangements 
Logical Reasoning 
Dial Setting * 


Landolt C Ring 
Apparatus IT 


Object Identification 
Test 


Form Board Test ** 
Memory for SyLlables{I) 
Sentence Span Test *** 


Behavior Interpretation 
Inventory 


Counting Accuracy 
“Aiming” Test 


Sentence Span Test 
Dial Setting 
Braunstein & White 
Apparatus 

Spatial Orientation IT 


Time Sharing Test 
(Mechanical) 


Form Board Test 
Sentence Completion Test 
GZTS: Restraint Scale 


Control Precision 


** Also measures (55) Spatial Visualization 
¥** Also measures (19) Verbal Knowledge 


VAL 


i A RS 


** 


** 


TABLE AA-8 


CELESTIAL AND SPACE-OBJECT RADIOMETRY: 
A POTENTIAL TEST BATTERY 


Word Arrangements (20) 

Logical Reasoning ( 28) 

Dial Setting (36, 37) 

Landolt C Ring Apparatus II (47) 
Object Identification Test (50) 

Form Board Test (54, 55) 

Memory For Syllables (I) (56) 
Sentence Span Test (60, 19) 
Behavior Interpretation Inventory (74) 
Counting Accuracy (75) 

"Aiming" Test (Aiming) 

Dial Setting (37) 
Braunstein and White Apparatus (47) 
Spatial Orientation II (48) 

Time Sharing Test (Mechanical) (49) 
Sentence Completion Test (57) 

GETZ: Restraint Scale (71) 


* Commander Pilot Only 
** Copilot Only 


ihe 


An exhaustive test battery, therefore, for this application would 
require a set of 17 tests as shown in Table AA-8. Eleven of these tests 
would be common; four additional tests would be required for the commander 
pilot; and two additional tests would be specific to the copilot. To 
return briefly to the specific example of y,, Contrast Ratio, it can be 
seen that the setting of the Contrast Ratio by the commander pilot would 
be predicted from test measures as follows: 


(3) Yg =f (Memory for Syllables (I), Braunstein and White Apparatus) 


It is obviously very doubtful that such an exhaustive test battery 
would be justified for the specific case of the scientific experiment, 
celestial and space-object radiometry. The cost of such a battery would 
probably only be justified in an extreme case where the entire mission 
success depended upon the specific task. 


However, this example sets the stage for the generation of a 
generalized test battery for the entire Extended Earth Orbital Laboratory. 
The following steps would be necessary: 


1. The type of analysis identifying the sociopsychological dimensions 
would have to be completed for all of the tasks executed by the crew in 
the mission. 


2. Across all tasks, the relative frequencies of sociopsychological 
dimensions can be established. This information immediately provides an 
indication of the relative priority and importance of the individual 
dimensions » 


3. A technical decision would have to be made as to those dimensions 
upon which information was necessary and those upon which expert judgment 
would suffice. This step involves the Cronbach and Gleser (ies) bandwidth- 
fidelity dilemma problem and the strategy that must be developed ( through 
utility analysis) to resolve this dilemma in constructing a cost-effective 
test battery. (See Chapter G) 


4. The utility analysis results in the selection of critical 
dimensions that must be measured in the generalized test battery. At 
this point, candidates for specific test instruments are assigned to the 
dimensions. Based on a number of criteria, an optimal set of tests will 
be derived comprising the generalized test battery for the entire context 
of the Earth Orbital Laboratory mission 
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Group and System ee Test Battery 
Level of Analysis Ans . DeveLopment 


Q 
1s 
To Predict What? 


System 
Criteria 


TABLE AA-3 


Q 
a 
Upon What Meastfres? 


1 


System 
Performance 
Measures 


s-m 


With What Tools? Upon What Measures?( > 


Human 
Performance 
Dimensions 


Q 
3 


s- 
With What Tools? 


With What Tools? 


* (1), (2) and (3) refer to equations in Appendix A text. 


FIGURE AA-3. The outputs resulting from the human performance 
prediction methodology are represented within the 
generalized methodological model. 
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APPENDIX A 


Summary 


The human performance prediction methodology presented in Chapter A 
through G was demonstrated in detail through application to a specific 
man-machine system activity: the conduction of celestial and radiometry 
experiments. Several detailed analyses were performed at several levels 
to provide answers to the first three of four basic and essential 
questions: 


1. To predict what? 
2. Upon what dimensions and measures? 
3. With what tools? 
4. For what purpose? 


The efforts expended to answer questions 1, 2 and 3 were directed by the 
answer to the fourth question: "To predict wWuman performance." It should 
be realized that if the purpose had instead been selection, classification 
or placement, the outputs of the efforts would not have been quite the same. 


The relationship of the first three questions to (1) the system, 
system-man, and man levels of analysis and (2) the end products of the 
analytic efforts is represented in Figure AA-3. Three points should 
be made concerning Figure AA-3: 


1. An analytic output may provide answers to different questions, 
depending on what level is under discussion (note Table AA-4 entry). 


2. Equations 1, 2 and 3 represent the functional relationships be- 
tween analytic outputs and, if quantitative, require transformations of 
the test measurement data. Since established and validated functions and 
rules for transformations 1 and 2 are not presently available, careful 
and thorough evaluation of data is called for; such evaluations, done with 
adequate initial and validation measurement sets on man-machine systems, 
would be invaluable. 


3. The fact that the analytical steps (the validity, of course, 
remains to be demonstrated) from Q1g to 3m could be executed for a test 
case to such a level of detail is remarkable; and provides 
strong support for the contention that the generalized methodological 
model is a conceptually meaningful one, well worth further examination. 
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APPENDIX B 


Mission and Task Analysis Examples 


Basic to the methodology used in this program, the functional 
process begins with the question: To Predict What? Thus, one must 
turn directly to the man-machine system performance which is to be 
predicted. For methodological purposes, a behavior sample had to be 
selected. As has been noted in Chapter B, a 180-day circular earth 
orbit mission was used for behavior analysis. Detailed task analyses 
were required at the microlevel. From these task analyses, the 
following subset has been selected as the most critical for present 
pruposes: 


1. The gross mission analysis, as shown on the following pages, 
from which the examples of rendezvous, docking and EVA are shown. 


2. Based on the Meister taxonomy, several portions of the mission 
were further analyzed with particular emphasis on space experiments, 
€.g-, conduct synoptic terrain photography, conduct inflight exercise, 
and so forth. The importance of this kind of information has been 
illustrated in Appendix A where the specific case of celestial and 
space-object radiometry experiments have been used to illustrate some 
of the methods recommended here. 


3. Because of the interest in group performance, analyses had 
to be made of the man-man-system problem. To illustrate the analyses 
completed in this area, the example of rendezvous and docking is 
given within this Appendix. 


it would appear that meaningful prediction programs for appli- 
cations context must be based on this kind of detailed performance 
analysis. The magnitude of this step, however, is apparent to anyone 
who has ever performed it. 
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FIGURE BB-1. Examples of the Gross Mission Analysis 
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FIGURE BB-2. Examples of the Detailed Task Analyses 
which were Performed 
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FEEDBACK 
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of. 
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medical data 
will be 
obtained. 
No blood Coordin- 
pressure ation 
reading will between 
be made - 2 crew 
incomplete members 
medical data 
will be 
obtained. 
No blood Coordin- 
pressure ation 
reading between 
will be 2 crew 
made - members. 
incomplete 
medical data 
will be 
obtained. 


BEHAVIOR: 


RESPONSE REQUIREMENTS 


Infor- 
Charact- mation Accuracy Time Stress 
e Mechanism eristics Presented Duration No. Content Type No. Reg. Req. Factors 
Remove Tac- Ser- Low. 30 sec. Zero-G 
cuff and tile ial/ 2 min. 
repack - Mul- 
instru- Gross ti- 
ment in Motor ple 
container 
Two Tac~ Dis- High- 5-10 Zero-G 
minutes tile crete must sec. 
before - Indi- accu- 
exercise Fine vidual rately 
experi- Motor locate 
mentor pulse 
should for 
now correct 
place reading. 
end & 3rd 
finger of 
his hand 
on pulse 
of 
subjects 
wrist. 
Count Tac- Ser- High - 15 Zero-G 
pulde tile ial/ Experi- sec. 
beat for - Mul- mentor 
next 15 Mental tiple must 
seconds. Visual concen- 
trate 
on 
watching 
clock and 
counting 
beats. 
Subject Tac- Ser- High - 10- Zero-G 
places tile ial/ strap 15 
both - Mul- must be sec. 
feet in Gross tiple positioned 
nylon and so it is 
foot Fine across 
strap. Motor shoe just 
in front 
of heel 
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FEEDBACK TASK CONTEXT 
Criteria 
of. ; 
Correct Number Task Failure Time 
Performance Modality Content Duration Personnel Embedding Structuring Consequence Sharing 


Equipment Direct Tactile Until 2 Part of Part of Equipment Coordin- 
is properly reading experiment checklist. may be ation 
removed of blood procedure. damaged. between 
and pressure and not 2 crew 
stored in is usable in members. 
container. camplete. future 

examin~ 

ations. 
Pulse beat Direct Tactile Until 2 Part of Part of Inaccur- Coordin-~ 
can be reading experiment checklist. ate place~ ation 
felt in of blood procedure. ment will between 
experimen- pressure cause poor 2 crew 
tor's is reading of members. 
fingers. complete. pulse. 
A count of Direct Tactile Until 2 Part of Part of Inatten- Coordin- 
the number Mental reading experiment checklist tion will ation 
of pulse of blood procedure cause between 
beats in pressure inaccurate 2 crew 
15 seconds is recording members « 
is obtained. complete. of beats. 
Nylon foot Direct Tactile Until 2 Part of Part of Strap may Coordin- 
strap is reading experiment checklist. slip and ation 
across of blood procedure. cause between 
bottom of pressure injury to 2 crew 
shoes just is subject or members. 
in front complete. damage to 
of heel. equipment. 
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BEHAVIOR: 


Infor- 


Charact- mation 


RESPONSE REQUIREMENTS 


Accuracy Time Stress 


Type Mechanism eristics Presented Duration No. Content Type No. Req. Req. Factors 
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With legs Tac- Ser- High- 10- Zero-G 
extended tile ial/ correct 15 
grasp Gross Mul- grip SEC o 
handie in Motor tiple impor- 
both hands. tant 
for 
proper 
manipul~ 
ation 
of 
equipment. 
Experi- 
mentor 
record 
pulse 
for 
next 15 
seconds 
(See # # 
above) 


Subject Tac- Ser- 
pull tile/ ial 
handles Gross Mul- 
toward 
face with 
legs 
extended 
so that 
rubber 
bunger 
cord is 
stretched 
to full 
length. 


Subject Tac- Ser- 
slowly tile ial/ 
releases Gross Mul- 
tension on * tiple 
rubber bunger 

cord so it 

returns to 

original, 
unstretched 
position. 


High- 4% sec. Zero-G 
in order 
for 


Motor tiple exercise 


to be 
beneficial 
it must 
be done 
correctly. 


High- 4 

In order s 
for 
exercise 
to be 
beneficial 
it must 
be done 
correctly. 


FEEDBACK TASK CONTEXT 


Criteria 
of : 
Correct Number Task Failure Time 
Performance Modality Content Duration Personnel Embedding Structuring Consequence Sharing 
Both hands Direct Tactile Until 1 Part of Part of Hands may Coordin- 
are reading experiment checklist. slip off ation 
gripping of procedure. handle between 
handle in blood causing 2 crew 
over hand pressure injury to members. 
position. is ‘subject or 
complete. damage to 
equipment. 

Robber Direct Tactile- Until 1 Part of Part of No benefit Coordin- 
bungee Visual reading experiment checklist. will be ation 
cord is of procedure. derived between 
stretched blood from 2 crew 
to its pressure exercise. members 
full is com- 

length. pleted. 

Rubber Direct Tactile- Until 1 Part of Part of No Coordin~ 
bungee Visual reading experiment checklist. benefit ation 
cord of procedure. will be between 
returns blood derived 2 crew 

to its pressure from members. 
natural is exercise. 
unstretched completed. 

state. 


ty. 


BEHAVIOR: 
Infor= 
Charact- mation 


e Mechanism eristics Presented Duration No. 
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RESPONSE REQUIREMENTS 


Accuracy Time Stress 
Content e No. Reg. Req. Factors 


Subject 
continues 
stretching 
and 
releasing 
cord at 
xate of 
once every 
second for 
next 29 
seconds, 


Experimentor 
records 
pulse rate 
for last 

15 seconds 
of exercise 


## 


Experimentor 
records 
pulse rate 
for 2 minutes 
at 15 second 
intervals 
following 
exercise # #, 


Experimentor 
takes subject 
blood pressure 
following 
completion of 
exercise #. 


BEHAVIOR: Conduct Synoptic Terrain 


Photography ee 
Charact- mation 
e Mechanism eristics Presented Duration No. Content e No. 
Visual Written - Single - Content - Short- Single Unpack Tactile Ser- 
elock Instruc- Visual Conduct lived camera Visual ial 
time tions to presen- synoptic Fine - - 
matehes conduct tation. terrain 5 sec. Gross Mul- 
event experiment photo- Motor tiple 
list. at specific graphy. 
time. 


Clean Tac- Ser- 
inter- tile ial/ 
ior - Mul- 
surfacé Vis- tiple 
of val 
window. Gross 
fine 
motor. 

Orient Tac- Ser- 
craft tile ial/ 
to land - Mul- 
mass is Vis- tiple 
below ual 
window Fine 
to be Motor 
used. pulse 

jets on 

proper 

side to 

rotate 

craft. 

# Hold Tac- Ser- 
camera tile iai/ 
so - Mul- 
that Fine tiple 
lens Motor 
is 
flat 
against 
window 
and 
land 
mass 
appears 
camera 


1th 


viewer. 


RESPONSE REQUIREMENTS 


Accuracy Time Stress 


Req. Factors 


10-20 Zero-G 
Sec. 


Req. 
High- 


avoid 
banging 
or hit- 
ting 
camera 
on 
portions 
of 
space- 
craft. 


High- 
clean 
window 
necessary 
for 

good. 
pictures. 


5-10 Zero~G 
SEC. 


High- 5 Zero-G 
rotation sec. 

must be - 
performed 5 

slowly min. 

in order 

to align 

vehicle 

properly. 


High - 5 Zero-G 
proper “ 

position 10 

of SEC 6 
camera 

will 

insure 

clear 

pictures. 


FEEDBACK 

Criteria 
of 

Correct 


TASK CONTEXT 


Number 


Task Failure 


Time 


Performance Modality Content Duration Personnel Embedding Structuring Consequence Sharing 


Camera Direct Tactile~ 
removed Visual 
from 
protective 
container 
and held 
in hand. 
Window Direct Visual. 
appears 
visually 
clean. 
Window Direct- Visual 
view land 
is of mass 
land is within 
MASS window 
viewe 
Camera Direct- Visual 
lens land 
flat mass 
against is 
craft's within 
window. window 
view. 


Through- 
out 
Photo~ 
graphic 
portion 
of 
mission. 


Once - 
unless 
window 
fogs. 


Remains 

in this 
position 
until 
experimentor 
requires 
change. 


Remains 

in this 
position 
until 
experimentor 
requires 
change. 


1 Part of 


experiment 
procedure. 


L Part of 


experiment 
procedure. 


1 Part of 


experiment 
procedure. 


1 Part of 


experiment 
procedure. 


175 


Part of 
checklist. will not 
be 
completed. 
Part of Experiment 
checklist. will not be 
completed. 
Part of Experiment 
checklist. will not 
be 
complete. 
Part of Experiment 
checklist. will not 
be 
completed. 


Experiment In voice 


comme 
with 
grnd 
station. 


In voice 
comm. 
with 

ground 

control. 


Coordin- 
ation 
between 
crewmen. 


Cordin- 
ation 
between 
crewmen. 


BEHAVIOR: RESPONSE REQUIREMENTS 


Infor- 
Charact- mation Accuracy Time Stress 
e Mechanism eristics Presented Duration No. Content No. Req. Reg. Factors 
Place Visual Ser- High- 5-10 Zero-G 
eye - ial proper sec. 


against Tac- - reading 
camera tile Mul- and 


view = tiple memori- 
finder Mental zation 
and read necessary 
lens to set 
settings lens 

that properly. 
appear in 

Pinder. 


Remove Visual Ser- High- 2-5 Zero-G 
camera - ial proper sec. 
from Tac- - setting 
window tile Mul- wil 

and - tiple insure 

set Mental good 

lens Fine photos, 
opening Motor 

and to 

speed Gross 

setting Motor 

just 

viewed 

in view 

finder. 


Replace 
camera 
as in 

#1 above. 


Place Tactile Ser- Low- 5-10 Zero-G 


eye Visual ial High sec. 
against Mental - Most 
view Mul- land 
finder tiple masses 
and viewed 
watch would 
for present 
appro- some 
priate data 
targets. for 
study. 
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FEEDBACK 


Criteria 
of 
Correct 


TASK CONTEXT 


Number Task Failure _ Time 

Performance Modality Content Duration Personnel Embedding Structuring Consequence Sharing 
View finder Direct- Visual Will 1 Part of Part of Experiment Coordin: 
will contain Experi- remain experiment checklist. will not be ation 
an "F" stop menter there procedure. completed. between 
reading and will see as long crewmem 
a "speed" these as 
setting. numbers camera 

within is held 

view in 

finder. position. 
Experi- Direct Tactile Until 1 Part of Part of Experiment Coordin- 
mentor = new experiment checklist. will not be ation 
will set Visual setting procedure. completed. between 
lens and is crewmen. 
it wilt indicated 
be within by 
previously camerae 
established 
limits. 
Land masses Direct Tactile Until 1 Part of Part of Experiment Orally 
will Visual photo- experiment Checklist. will not report 
appear in graphy procedure, be each 
view finder is completed. photo 
as craft completed. taken. 
orbits 
earth. 
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BEHAVIOR: RESPONSE REQUIREMENTS 


Infor- 
Charact- nation Accuracy Time Stress 
Type Mechanism eristics Presented Duration No. Content Type No. Rege Req. Factors 
Depress Tactile Dis- High- 2 Zero-G 
camera. - crete must SEC oe 


trigger Fine - be 
to take Motor Indi- done 


photo of vidu- smoothly 

land al sO as 

mass. not to 
move 
camera. 

Continue 

photographing 

land masses 

until film 


in magazine 
is expended. 


Remove Tac- Ser- Low- 10-20 Zero-G 


camera tile ial/ care sec. 
from - Mul- must be 
window Gross tiple taken 

and dis- Fine but 

connect Motor task is 
magazine. simple. 


Receive Tac- Ser- Low- 10-20 Zero-G 


new tile ial/ care sec. 
magazine - Mul- must 
from Fine- tiple be 
partner Gross taken 
and Motor but 
attach task is 
it to simple. 
camera. 

Continue 

as in #2 

aboves 
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FEEDBACK 


TASK CONTEXT 


Criteria 

of 
Correct Number Task Failure 
Performance Modality Content Duration Personnel Embedding Structuring Consequence Sharing 
Camera Direct Tactile Until L Part of Bart of Experiment 
shutter - photo- experiment checklist. will not 
elick Visual graphy procedure. be 
will is completed. 
be heard completed. 
and film 
will 
automatically 
advance. 
Magazine Direct Tactile Until L Part of Part of Experiment 
comes - magazine experiment checklist. will not 
off Visual is procedure. be 
camera removed. completed. 
New Direct Tactile Until 2 Part of Part of Experiment 
magazine - magazine experiment checklist. will not 
is Visual film procedure. be 
attached is completed. 
to expended. 
camera 
and 
locked 
one 
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i 


. Time 


Orally 
report 
each 
photo 
taken. 


Coordin- 
ation 
with 
other 
crewmen. 


Coordin- 
ation 
with 
other 
crewmen. 


Initiating Stimulus Characteristics 


Type Mechanism 
Visual~ Written 
Clock Material 
time Instructions 
matches to prepare 
event for EVA at 
list. specified 

time. 


BEHAVIOR: Prepare for Scheduled EVA 


Duration 


Characteristics Information 
Presented 
Multiple-Visual Content - 
Presentation on Prepare for 
elock and audi- EVA. 


tory message from 
ground station to 
prepare for EVA. 
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Short-Lived- 


5 Seconds 


Number 


Multiple-2 

Visual-List 

Auditory- 
Commun. 


Content 


Insure S/C 
mirror is out 
of way. 


Position 
waste pouch 
for jetti+ 
soning 


Record to 
CONT 


Keying to 
VOX 


Hold. 
Umbilical 
in lap 
(Remove 
bag) 


@ Verify 
cabin Re- 
circ. valve 
dwn (closed) 


@ Verify 
cabin check 
valve open 


Response Requirements 


Type Number 

Perceptual- Discrete/Indiv 
Visually 

insure 

mirror 

stowed. 

Fine motor- Discrete/Indiv 
lift pouch 

Fine motor- Discrete/Indiv 
turn switch 

Fine motor- Discrete/Indiv 


move switch 


Gross physical- Serial multi- 
lift umbilical ple- Hold bag, 


from bag pull umbil. 
out of bag 
Perceptual- Discrete/Indiv 
visually 


insure valves 
in correct 
position 


Accuracy Time Stress 
Requirements Requirements Factors 
High-Mirror cld Instantaneous Performed 
foul umbilical. in Zero 
with full 
pressuri- 
zed suit. 
High-Damage to 10 sec. 
pouch could be Performed 
dangerous. in Zero 
with full 
pressur- 
ized suit. 
High- Loss of Instantaneous Performed 
record could in Zero 
result with full 
pressur- 
ized suit 
High- No com- Instantaneous Performed 
munication. in Zero 
with full 
pressur- 
ized suit 
High-Umbil must 2-5 Min. Gloved 
be kept from un- hand 
raveling into 
cabin. 
High- Pressur- 5-10 Sec. Performed 
ization loss(?) in Zero 
Unable to open with full 
hatch pressur- 
ized suit 
182 


ae 


Criteria 


of Number Task Failure Time 
Correct Modality Content Duration Personnel Embedding Structuring Consequence Sharing 
Pref. 
Mirror Direct- Visually Until 2 Part of Part of EVA Mirror 
out of Visually -Pilot moved proc for checklist could 
way pilot sees into EVA damage 
can see mirror another umbilical 
mirroris in positim and 
stowed stowed cancel 
positim. EVA 
Pouch in Direct- Visually Until 1 Part of Part of EVA Damaged 
position Visually pouch disposed proc for checklist pouch 
and not Pilot can in of EVA could 
broken see posi- position cause 
tion and No leaks danger to 
no crew and 
leakage. vehicle. 
Recorder Direct- Recorder Until EVA 1 Part of Part of EVA Recorder Voice comm 
On Visually ON is over proc for ehecklist not on or with grnd 
EVA operating station 
- loss of 
info. 
Voice Direct- Key on Until EVA HE Part of Part of EVA Loss of Voice comm 
comm is Visually VOX is over proc for checklist voice with grnd 
estab- and position EVA comm. station 
lished Auditory grnd. 
comm est. station 
audible 
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CONTENT 


RESPONSE REQUIREMENTS 


Determine Initial Condition 
for First Rendezvous Cor- 
rection 


Monitor Spacecraft System 
Status 


Check Subsystems Master 
Warning Lights 


Check Electrical Power 
Supply 


Determine 
accomplish First Rendezvous 
Maneuver 

Synchronize Event Timer 
Switch Computer to Rendez- 


vous Mode 


#1 Boresight on Target 
Vehicle 


Verify Perpinent Computer 


Constants 


Record Elevation 
Range to Target Vehicle 


Determine when Initation 
Point is Reached 


Lock on Radar 


Depress START COMP button 


ACCURACY TIME STRESS 
TYPE NUMBER REQUIREMENTS REQUIREMENTS FACTORS © 
Perceptual- Serial- High 1 - 5 min. Zero G 
Motor Multiple 
Perceptual Serial - High 30 seconds- zZero G 
Multiple 1 minute 
Perceptual Serial- High 30 seconds- Zero G 
Multiple 1 minute 
Perceptual Serial- High 30 seconds- Zero G 
Multiple 1 minute 
V Required to Mediational- Serial- High 4 min. Zero G 
Perceptual Multiple 
Motor- Serial- High 15-30 sec. Zero G 
Perceptual Multiple 
Motor- Discrete- High 1O-15 sec. Zero G 
Perceptual Individual 
Motor- Serial- High 1-5 min. Zero G 
Perceptnal Multiple 
Visual- Serial. High 1-5 min. Zero G 
Médiational Multiple 
(Computational) 
and Motor-Visual Serial- High 1-5 min. Zero G 
Mediational Multiple 
(Computational) 
Visual- Serial- High 1-5 min. Zero G 
Mediational Multiple 
(Decision- 
Making) 
Visual-Tactile Serial- High 80 sec. Zero G 
Multiple 1 min. 
Visual- Discrete High 1-5 sec. Zero G 
Tactile 
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FEEDBACK 


TASK CONTEXT 


FATLURE 


STRUCTURING CONSEQUENCES 


CRITERIA 
OF NO. 
CORRECT PERS- TASK 
PERFORMANCE MODALITY CONTENT DURATION | ONNEL EMBEDDING 
Initial Computer MSC Until Part of Performed 
Conditions Display- Voice thrust R&D according 
will provide Auditory Message is com- Procedure to check 
correct info Verifies plete. list. 
for Rendez- Initial 
vous Correct- Condi- 
ion- tion 
System is Visual- All Periodic Normal Routine 
GO Status system procedure 
Lights lights to scan 
Green system 
status 
pertodic- 
ally. 
All warning Visual- All Periodic Normal Routine 
lights are Master Master procedure 
extinguished warning Warning to scan 
lights. Lights system 
Out. status 
periodic- 
ally. 
All elec- Visual- Power Periodic Normal Routine 
trical Power Supply Procedure 
power Gauges Gauges to scan 
within within system 
limits. proper status 
limits periodic- 
ally. 
Calcula- Visually Computer During Discrete Routine 
tion readout- change i maneuver. 
permit Bore- orbit. 
success sight on 
of ren- agena 
dezvous 
maneuver 
Event timer Visually Event During Part of Routine 
agrees with Timer change R&D 
MSC report reads in procedure. 
00:00 orbit. 
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R & D cannot 
be completed. 


May not see 
warning 
light. 


May not see 
warning 
light. 


May not see 
warning 
light. 


Failure to 
rendezvous. 


Can be 
repeated 
no ser- 
ious 
conse- 
quences. 


TIME 
SHARING 


Auditory 
Voice 
Commun. 


Auditory 
Voice 
Commun. 


Auditory 
Voice 
Commun. 


Auditory 
Voice 
Commun. 


Auditory 
Voice 
Commun. 


FIGURE BB-3. A Man-Man, Man-Machine Analysis for 
Rendezvous and Docking is given. 
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SOT 


TASK MAN MAN MAN 
DESCRIPTOR (COMMANDER) (NAVIGATOR) (SYSTEMS ENG) MACHINE 

Determine required 

to accomplish first 

rendezvous maneuver 
Look at display Secure tape recorder Continuous update of 

range (six 
digit numeric readout) 

Look at FDAT Look at FDATI Disconnect batteries Continuous attitude 


Reach out and push 
AGC switch UP 


Look at AGC display 


Key microphone 


Report to MSFN earth 
orbit parameters 
from AGC display 


Reach out and push 
C/M propellant jet 
logic switch down 
(OFF) 


Reach out and push 
EOS power switch 
down (OFF) 


from main busses 


Charge batteries, 
if necessary 


Transmit real time 
T/M 


Transmit recorded 
T/M 


Record real time 
T/M 


information displayed 
in pitch, yay and roll 


Activates guidance 
computer to determine 
attitude error 


Display of attitude 
error and orbit 
parameters 


Opens communication 
circuit 


C/M propellant jet 
logic system OFF 


MAN 
( COMMANDER) 


MAN 
(NAVIGATOR) 


MAN 
(SYSTEMS ENG) 


MACHINE 


6QT 


Reach out and push 
master events 
sequence pyro 
switch dow (OFF) 


Reach out and push 
master events logic 
switch down (OFF) 


Reach over and pull 
out all EOS circuit 
breakers 


Reach over and pull 
out all ELS circuit 
breakers 


Reach over and pull 
out all master events 
control circuit 
breakers 


Set controls and 
displays for earth 
orbit phase 


Perform G + C System 
check 


Set controls and 
displays for earth 
orbit phase 


Key microphone 


Acknowledge commu- 
nications acquisition 


Set ECS for orbital 
operation 
Key microphone 


Transmit real time 
Transmit recorded T/M 


Check ECS pressure 
displays 


Check ECS temperature 
displays 


Pyro switch is in 
safe position and 
unarmed 


Master events logic 
off 


Disconnects d-e power 
from battery to APEX 
cover jett switch - 
Drogue delay switch- 
and main deploy switch 


Voice circuit open 


Display within Limits 


Display within limits 


TASK MAN MAN MAN 
DESCRIPTOR ( COMMANDER) (NAVIGATOR) (SYSTEMS ENG) MACHINE 


a I 


O6T 


Check ECS quantity 
displays 


Check oxygen flow 
rate displays 


Check both cabin 
air fans 


Check cabin temper-~- 
ature control 


Check both suit 
compressors 


Check both glycol 
pumps 


Check water accumu- 
lators 


Check emergency 
coolant Loop 


Check ECS Radiators 
Record real time T/M 


Check DC voltage and 
ampere displays 


Check AC voltage and 
frequency displays 


Check pressure and 
quantity of cryogenic 
oxygen and hydrogen 
tanks 


Check AC inverters 


Display within limits 


Display within limits 


Switches on 


Display within limits 


Display within limits 


Switches on Manual 


Switches on Manual 


Switches Off 


Switches Off 


Display within limits 


Display within limits 


Display within limits 


Switch controls d-c 
power to a-c inverter 


TASK 
DESCRIPTOR 


T6T 


MAN 
( COMMANDER) 


Test .05 G light 


Test G increase and 
skipout lights 


Check scripe on 
mylar scroll 


MAN 
(NAVIGATOR) 


Check SM-RCS sub- 
system A pressure- 
temp-Quan meter 
indicator 


Check SM-RES Sub- 
system B 
Press-Temp-Quan 
meter indicator 


Check SM-RCS sub- 
system C 
Press-Temp-Quant 
meter indicator 


CheckSM-RES subsystem 


D Press-Temp-Quant 
meter indicators 


Check SM-RCS helium and 
propellant valve event 


indicators 


MAN 
(SYSTEMS ENG) 


Check AC busses 


Check each fuel cell 
Check Cryogenics Ho 
heaters 


Check cryogenics Ho 
fans 


Check cryogenics Op 
heaters 


Check cryogenics Oo 
fans 


MACHINE 


Switch controls a-c 
output of Inverter 
No. 1 


Switch indicator-flow- 
radiators-heater 


Check switch position 


Check switch position 


Check switch position 


Check switch position 


Switch select "A" 
Observe-display within 
limits 


Switch select "B" 
observe-display within 
limits 


Switch select "C" 
Observe-display within 
limits 


Switch Select "D" 
Observe-display within 
limits 


Observe indicator 


Si 


TASK 


DESCRIPTOR (COMMANDER) 


Z6T 


Turn on and run IMU 
acceLerameters 


Interrupt S-IVB 
attitude control and 
roll C/M to bisect 
two reference stars 
with C/M optics 


Prepare for IMU Maintain roll attitude 


fine alignment 


MAN 
(NAVIGATOR) 


Check CM-RCS subsystem 
A, Press-Temp meter 
indications 


- Check CM-RCS subsystem 


B Press-Temp meter 
indications 


Check CM-RCS event 
display indications 


Check CM-SM caution 
and warning lights 


Check CM caution and 
warning lights 


Turn on map and data 
viewer 


Display fine alignment 
sequence and data on 
M & DV 


MAN 
(SYSTEMS ENG) 


Check SPS Press-Temp 
and Quan. meter 
indications 

Check SPS event dis- 
play indications 


Log results of checks 


Prepare and ingest 
food 


Transmit real time T/M 
Transmit recorded T/M 


Record real time T/M 


MACHINE 


Switch select "A" 
Observe-display within 
limits 


Switch select "B"- 
Observe-display within 
limits 


Switch select "C"~ 
Observe/Write display 
within limits 


All OFF 


All OFF 


Initializes the 
inertial subsystem 


Turning of rotation 
control causes 
thrust vectors to 
fine and roll space~ 
craft in direction 
of rotation 


TASK MAN MAN MAN 
DESCRIPTOR (COMMANDER) (NAVIGATOR) (SYSTEMS ENC) MACHINE 


Determine desired 
inertial attitude 
reference 


Determine bisector of 
two reference stars 


Perform IMU fine alignment Slave telescope to Optics power ON Navigator manually 
star LOS sights stars 
Optics control on 
appropriate speed Switch action to Hi-Med 
or Low regulates 
voltage 
Optics mode on resolved Coupling (switch) with 
hand controlier 
Enter fine alignment Push buttons on 
program into AGC (AGC computer 


€6T 


will point telescope 
and sextant optics at 
reference star) 


Determine first star 


in M & DV 
Enter first star code Push buttons on 

number into AGC computer 

Optics control to Switch action - hand 
manual controller Output 


direct to sextant 


Identify first star in 
M & DV and telescope 


Center first star in Hand crank operation 
telescope with optic to slow telescope 
hand controller 


Verify first star in 
sextant 


TASK MAN MAN MAN 


H6T 


enable switch ON 


Push mark button 
when star is centered 


Push mark reject 
button if mark is 
unsat. and repeat work 


Turn minimum impulse 
enable switch OFF 


Optics control to 
computer 


Determine second star 
in M & DV 


Enter second star code 
number into AGC 


AGC will point tele- 
scope and sextant 
optics at reference 
star 


Optics control to manual 


Identify second star 
in telescope 


Center second star in 
telescope with optics 
hand controller 


DESCRIPTOR (COMMANDER) ( NAVIGATOR) (SYSTEM ENC) CE 
A 
Center first star Handcrank 
in sextant with 
optic hand controller 
Turn minimum impulse Switch ON 


Push button - computer 
input 


Switch OFF 


Computer reads angles, 
time and computes 
position of space- 
craft 


Push buttons on 
computer 


Automatic slew 


Switch down 


Hand crank 


TASK MAN MAN MAN MACHINE 
DESCRIPTOR (COMMANDER) (NAVIGATOR) (SYSTEM ENG) 


Verify second star 
in sextant 


Center second star in Hand crank 
sextant with optics 
hand controller 


Turn minimum impulse Switch ON 
enable switch ON 


Push mark button when Push button 
star is centered 


Push mark reject 
button if mark is 
unsat. and repeat 

work 


Turn minimum impulse Switch OFF 
enable switch OFF 


S6T 


Verify completion of Calculations complete 
fine alignment program 
by AGC display 


IMU alignment Display alignment check 
Check sequence sequence and data on 
M & DV 
Enter alignment check Push buttons 


program into AGC 
Optics control to computer Repeat above 


Determine reference 
star in M & DV 


Enter reference star 
code number into AGC 


AGC will point telescope 
and sextant optics at 
reference star 


96T 


TASK 
DESCRIPTOR 


MAN 
(COMMANDER) 


Roll S/C to S-IVB 
desired attitude 
and return attitude 
control to S-IVB 
instrumentation unit 


MAN 
(NAVIGATOR) 


Optics control to 
manual 


Identify reference star 
in M & DV and telescope 


Center reference star 
in telescope with 
optics hand controller 


Verify reference star 
in sextant 


Center reference star in 
sextant with optics 
hand controller 


Turn minimum impulse 
enable switch ON 


Push mark button when 
star is centered 


Push mark reject button 
if mark is unsat. and 
repeat work 


Turn minimum impulse 
enable switch OFF 


Verify completion of 
IMU alignment and 
check and alignment 
accuracy by AGC display 


MAN 
(SYSTEM ENG) 


MACHINE 


Turning of rotation 
control causes 
thrust vectors to 
fire and roll space- 


craft in direction 
of rotation 


TASK 
DESCRIPTOR 


MAN 
(COMMANDER) 


MAN 
( NAVIGATOR) 


(SYSTEM ENG) 


MACHINE 


Perform landmark 


navigational sighting 


L6T 


Interrupt S-IVB 

attitude control and 
maintain appropriate 
roll control 


Display navigation 
sighting sequence 
and data on M & DV 


Determine pertinent 
data on next landmark 


Slave telescope to 
star LOS 


Optics control on 
appropriate speed 


Enter earth orbit 
navigation sighting 
program into AGC 


Optics control to 
computer 


AGC will point tele- 
scope and sextant 
optics at reference 
point 


Optics control to 
manual 


Verify landmark in 
M& DV and telescope 


Center landmark in 
telescope with optics 
hand controller 


Turn minimum impulse 
enable switch ON 


Repeat of previous 
guidance information 


96T 


TASK MAN MAN MAN MACHINE 
DESCRIPTOR (COMMANDER) (NAVIGATOR) (SYSTEM ENG) 


Cd 


Push mark button when 
landmark is centered 


Push mark reject button 
if mark was unsatis- 
factory and repeat mark 


Maintain landmark in 
telescope field of 
view with optics hand 
controller for several 
seconds 


Center landmark in tele- 
scope with minimum 
impulse control 


Push mark button when 
landmark is centered 


Push mark reject button 
if mark was unsat. and 
repeat mark 


Turn minimum impulse 
enable switch OFF 


Obtain comparison of 
actual trajectory para-~ 
meters and the desired 
or nominal trajectory 
by AGC display 


Turn off M & DV 
Transmit real time T/M 


Record real time T/M 


Perform SM-RCS Perform ECS status eee positions 
status check check checke 


66T 


TASK 
DESCRIPTOR 


End Navigation 
sighting period 


Present trajector 
computation 


MAN 
(COMMANDER) 


Perform operational 


check of caution and 


warning lights 


Secure navigation 
sighting controls 
and displays 


Roll C/M to S-IVB 
desired attitude 
and return attitude 
control to S-IVB 


instrumentation unit 


Preparation and 
ingestion of food 


MAN 
(NAVIGATOR) 


Secure navigation 
sighting controls 
and displays 


Compute and display 
present trajectory 
error and uncertainty 
factors using land- 
mark sighting data 


Compute and display 
ephemeris miss distance 
and uncertainty factors 


MAN 
(SYSTEM ENG) 


Perform operational 


check of ECS, normal, 
alternate and backup 


modes 


Perform EPS status 
check 


Perform operational 


check of EPS, noxmal, 
alternate and backup 


modes 


Perform SPS status 
check 


Secure navigation 
sighting controls 
and displays 


Optics power OFF 


MACHINE 


View C & W panel - 
All lights off 


Switches and meters 
within limits 


Switches and meters 
within limits 


Switches and meters 
within Limits 


Stow telescope and 
sextant 


See previous ROLL 
operation 


Computer operation 


Computer operation 


mo 


TASK MAN MAN MAN 
DESCRIPTOR (COMMANDER) ( NAVIGATOR) (SYSTEMS ENG) MSEHINE 
Compute and display Computer operation 


Prepare for IMU 
alignment 


00¢ 


Compare trajectory 
and ephemeris 


on board determination 
of rendezvous para- 
meters 


Turn on map and data See previous similar 
viewer area starting on 
page 


Display course alignment 
sequence and data on 
M & DV 


Determine desired 
inertial attitude 
reference 


Determine bisector of 
two reference stars 


Interrupt S-IVB attitude 
control and roll C/M 
to bisect two reference 
stars with C/M optics 


Maintain roll attitude 
Transmit real time T/M 
Transmit Recorded T/M 
Compare trajectory Communications 
ephemeris and uncer- 


tainty factor data 
with MSFN 


TASK MAN 
DESCRIPTOR (COMMANDER) 


MAN 
(NAVIGATOR) 


(SYSTEMS ENG) 


MACHINE 


Obtain rendezvous 
parameter data from 
MSFN and compare with 
on board generated 
data 


Toe 


Slave telescope to 
LOS 


Optics control on 
appropriate speed 


Enter course align- 
ment program into 
AGC 


Optics control to 
computer 


Determine first star 
in M & DV 


Enter first star code 
number into AGC 


AGC will point tele- 
scope and sextant 
optics at reference 
star 


Optics control to 
manual 


Identify first star in 
M & DV and telescope 


Center first star in 
telescope with optics 
hand controller 


Record real time T/M 


Computer output check 
against MSFN data 


o0d 


TASK 
DESCRIPTOR 


MAN 
(COMMANDER) 


MAN 
(NAVIGATOR) 


Turn minimum impulse 
enable switch ON 


Push mark button when 
star is centered 


Push mark reject 
putton if mark is 
unsatisfactory and 
repeat mark 


Turn minimum impulse 
enable switch ON 


Optics mode to 
computer 


Determine second star 
in M & DV 


Enter second star code 
number into AGC 


AGC will point tele- 
scope and sextant 
optics to reference 
star 


Optics control to manual 


Identify second star in 
M & DV and telescope 


Center second star in 
telescope with optics 
hand controller 


Turn minimum impulse 
enable switch ON 


Push mark button when 
star is centered 


MAN 
(SYSTEMS ENG) 


MACHINE 


TASK MAN MAN 
DESCRIPTOR ( COMMANDER) (NAVIGATOR) 


Push mark reject 
button if mark 
is unsatisfactory 
and repeat mark 


Turn minimum impulse 
enable switch OFF 


Verify completion of 
course alignment 
program by AGC 
display 


€02 


AS BEFORE 


Perform IMU fine 
alignment check 


Roll ¢/M to S-IVB 
desired attitude 
and return attitude 
control to S-IVB 
instrumentation unit 


Secure navigation 
station for 
orbit change 


MAN 
(SYSTEMS ENG) 


Secure earth orbit 
controls and 
displays 


Optics power OFF 


MACHINE 


Button pushing 
operation 


Thumbwheel operation 


SEE PREVIOUS ROLL 
DATA 


i 


YOu 


TASK 
DESCRIPTOR 


Prepare AGC for 
orbit change 


MAN 
( COMMANDER) 


Obtain IMU attitude 
data from AGC 


Insert data in 
attitude set display 


Push GDA align button 


Secure center couch 
for orbit change 


Count down to insertion 


Review preparations for 
insertion 


Adjust couch restraints 


MAN 
(NAVIGATOR) 


Enter program 


Enter CG offset angle 


Enter programmed 
thrust vector 


Enter programmed 
Delta V minus SPS 
tailoff 


MAN 
(SYSTEMS ENG) 


MACHINE 


Computer readout 


Push button operation 


Push button-Aligns 


Set SPS switches and 
controls for quick 
abort contingency 
capability 


Connect batteries to 
main busses 


Secure engineer 
station for orbit 
change 

Secure recorder 


Count down to insertion 


Review preparations for 
insertion 


Adjust couch restraints 


GDC to given reference 


TASK MAN MAN MAN MACHINE 
DESCRIPTOR (COMMANDER) (NAVIGATOR) (SYSTEMS ENG) 


eT 


S/C preparation for 
insertion Set SPS switches, Switches 
controls and gimbal 
motors for quick 
abort contingency 
capability 


Set elapse time clock Switch operation 
Transmit real time T/M 
Transmit recorded T/M 


Secure commander 
station for insertion 


Observe elapse time clock Observe timer 
8 Countdown to insertion Observe timer 
Adjust couch restraints Tighten restraints 
Start S-IVB Vllage Monitor progress of Monitor progress of Monitor progress of Observe meters 
acceleration vilage sequence vilage sequence vllage sequence operating within 
Limits 


Record real time T/M 


Start of Propulsion 


system ignition Monitor program 
Observe elapse time Observe master timer Timer operating 
clock 
Observe caution and Observe caution and Observe caution and All lights OFF 
warning indicator warning indicator warning indicator 
Observe FDAI display Observe AGC display Observe crew safety Attitude correct 


indicators 


TASK MAN 
DESCRIPTOR (COMMANDER) 


MAN 
(NAVIGATOR) 


MAN 
(SYSTEMS ENG) 


MACHINE 


et Pf 


Observe 
display 


Observe EOS display 


Countdown thru 


insertion sequence 


of events 


902 


S-IVB propulsion 
cutoff 


Post injection check 
Set controls for 
coast 


Release couch 
restraints 


V remaining 


Observe FOS display 


Observe crew safety 
indicators 


Observe critical 
systems indicators 


Countdown thru 
insertion sequence 
of events 


Set control panel 
for coast 


Release couch 
restraints 


Observe critical 
system indicators 


Countdown thru 


insertion sequence 
of events 


Record real time T/M 


Transmit veal time T/M 


Transmit selected 
comments on progress 


Disconnect batteries 
from main busses 


Check DC voltage 
and amperage 


Check AC voltage am- 
perage and frequency 


Check cryogenic 
quality, pressure 
and temperature 


V display 


EOS within limits 


Clock moving 


Electrical Power 


Meters within linits 


Meters within limits 


Meters within limits 


TASK 
DESCRIPTOR 


( COMMANDER) 


MAN MAN 
(NAVIGATOR) (SYSTEMS ENG) 


MACHINE 


Confirm safe coast 
trajectory 


102 


Post V SPS gimbal 
operation 


Compute V state vectors 
Check actual V para- 
meters with programmed 
V parameters 


Compare on board Vv 
data with MSFN 


Turn off gimbal motors 


Turn off quick abort 
capability 


Check fuel cell 
displays 


Release couch 
restraints 


Check subsystem "A" 
pressure, temperature, 
quantity and event 
displays 


Check subsystem "B" 
pressure, temp, quantity 
and event displays 


Check subsystem "C" 
pressure, temp, 
quantity and event 
displays 


Check subsystem "D" 
pressure, temp, 
quantity and event 
displays 


Adjust PV valve 


Meters within limits 


Communications 


SEE PAGE 


Switch off 


Switch off 


TASK MAN 
DESCRIPTOR (COMMANDER) 


MAN 


(NAVIGATOR) (SYSTEMS ENG) 


MACHINE 


Orient S/C to specified 
attitude for trans- 
position and docking 


ECS check 


SCS attitude alignment 


Place G & Nin 
attitude control 
mode 


80e 


Verify S-IVB in 
attitude hold 


Arm pyro circuit 


Check pressure, temp., 
quantity, event and 
flow displays 


Obtain IMU attitude data 
from AGC 


Insert data into 
attitude set display 


Push GDC align button 


Confirm S/C status with MSFN 
Program AGC for V mode 

AGC automatically orients 
s/c to V attitude 

Enter GC offset into AGC 

Enter V direction vector 
into AGC 


Enter programmed. Vv 
minus tailoff into AGC 


Enter CG offset angles into 
gimbal position display 


Attitude control 
activated S/C changes 
attitude 


All within Limits 


Computer readout 
Push buttons 


Push botton 
Switch 
Communications 


Switch 
Switch 
Computer 


(pushbutton operation) 


Computer (pushbutton 
operation) 


Computer (pushbutton 
operation) 


Thumbwheel 


TASK 
DESCRIPTOR 


MAN 
( COMMANDER) 


MAN 
(NAVIGATOR) 


MAN 
(SYSTEMS ENG) 


MACHINE 


ee A  E 


SCS preparation for 
Vv 


Insert programmed 
V including 
tailoff into V 
remaining display 


Monitor elapse time 
clock 


Verify programmed 
attitude hold 


Turn on gimbal motors 


Check gimbal position 
displays 


AGC initiates SM-RCS 
vllage 


Monitor FDAT 


Monitor 
display 


V remaining 


Observe displays on 
G and N panel 


Insert time to V 
in elapse time clock 


Observe master timer 


Monitor FDAI 


Observe displays on 
G & N panel 


Connect entry 
batteries to main 
buss 


Observe critical EPS 
displays 


Re 


Switch activation- 
Clock set 


Pushbutton 


Switch ON 


Readout - within 
limits 


Computer operation 
Activated and 

eycLing 
Attitude holding steady 


Numbers decreasing 


All within limits 


TASK MAN MAN MAN 
DESCRIPTOR ( COMMANDER) (NAVIGATOR) (SYSTEMS ENG) MACHINE 
Monitor V Maneuver Stop SM-RCS vllage Observe master Monitor SPS fuel and Switch off 


Monitor V remaining 
display 
Monitor FDAT 


Observe displays on 
G@ & N panel 


Ole 


REPEAT WHOLE SEQUENCE FOR EA 


timer 


Monitor FDAT 


Observe displays on 
G & N panel 


oxidizer quantify 
displays 


Observe SPS pressure 


and temperature 
displays 


CH ORBITAL 


CHANGE UNTIL RENDEZVOUS Is ACCOMPLISHED 


Display within limits 


All within limits 


Attitude steady 


All within limits 


APPENDIX C3; PRELIMENARY ANALYSIS OF THREE 
CURRENT TASK TAXONOMIES 


Introduction 


As demonstrated by the examples presented in Appendix B (Figure BB-2), 
several of the activities which might occur during a space flight or an 
extended stay in a manned orbiting vesearch laboratory were described at a 
micro level of detail using Meister's Task Dimensional Taxonomy. In light 
of the project goal, human performance prediction in man-machine systems, 
it was desirable to evaluate various existing analytic and descriptive be- 
havioral taxonomies to (1) discover what they might offer in terms of a 
procedure for mapping the detailed task descriptions into behavioral 
categories and (2) to determine how to measure the usefulness and effec- 
tiveness of a taxonomy for any particular purpose this effort took place 
prior to the development of the mapping and analysis procedures outlined 


It was decided to try out three quite different behavioral taxonomies, 
two analytic (Miller and Alluisi) and one descriptive (Meister), as a 
heuristic exercise which might provide insight and, possibly, answers to 
the following set of questions: 


1. Could the mapping activity be performed? If so, how satisfactory 
was the mapping performance? 


2. Did the taxonomic categories serve to adequately describe, define 
and differentiate between the behaviors? 


3. Did the taxonomies appear to offer any obvious advantages or 
disadvantages? 


It should be recognized that the critical evaluations made of these 
taxonomies will necessarily tend to cover either the analytic (generally 
applicable behavioral interpretations) or the more activity-specific 
descriptive taxonomies. The two types of taxonomies are not directly 
comparable even through discussed with respect to the same criteria. 
Further discussions of the three taxonomies appear in Chapters B and C. 


Method 


The micro level task descriptions for two activities provided the 
items to be categorized according to the three taxonomies. These 
activities were: the Rendezvous and Docking mission (description of this 
activity at the Man-Man, Man-Machine Interaction level is provided in 
Appendix B, Figure BB-3) and one of the scientific experiments, Inflight 
Exercise-Work Tolerance (micro level description example appears in 
Appendix B, Figure BB-2). Since both of these activities involve 


considerable repetition, a subset of nonrepeated items was selected for 
each. As a result, the list of task descriptions for Rendezvous and Docking 
consisted of 58 items while the Inflight Exercise-Work Tolerance list 
consisted of 24 items. These two lists each provided an axis for separate 
matrices. 


The other axis for both matrices consisted of the categories provided 
by each of the three taxonomies. A brief description and the set of 
categories is given below for each taxonomy. Further discussion is 
provided in the text in Chapters B and C. 


(1) The Alluisi Taxonomy. The six category system of Alluisi is 
said io ‘be a sufficient set of functions to interpret all described task 
behaviors. 


Categories: Watchkeeping 
Sensory-perceptual functions 
Memory functions (short and long) 
Communications functions 
Intellectual functions 
Perceptual-motor functions 


(2) The Miller Taxonomy. This list is an eight-step sequential 


categorization; i.e., each item must be considered in order for each 
task description. This system, ag&in, is said to be sufficient to 
categorize all task behaviors. 


Categories: Concept of purpose 
Scanning function 
Identification of relevant cues function 
Interpretation of cues 
Short-term memory 
Long-term memory 
Decision making and problem solving 
Effector response 


(3) ‘The Meister Taxonomy. Level 2 of Meister's Descriptive 
Behavioral Taxonomy was selected. It is specifically oriented towards 
space flight activities. 


Categories: Perform control-display operations 
Tracking 
Record data received 
Communicate 
Observe external vehicle events 
Perform quantitative computations 
Perform preventive maintenance 
Make decisions 
Put on/ remove personal equipment 


Open/close doors, hatches, access covers, etc. 
Move from one vehicle location to another 
Read written material 

Precise control manipulations 


Two members of the project staff independently performed the exercise 
of mapping each one of the task descriptors to those taxonomic categories 
which seemed either to provide an appropriate behavioral interpretation 
(Alluisi and Miller) or behavioral description (Meister). A match was 
indicated by checking the appropriate matrix cell. Evaluation of the 
mapping efforts proceeded along two lines: (1) the responses of the 
personnel to the questions posed above and (2) the relative inter-analyst 
agreement as indicated by checked cells of the matrices. 


Evaluation Results 


The mapping efforts proved to be very beneficial heuristically in that 
several difficulties became evident in the attempt to apply the taxonomies, 
particularly those of Alluisi and Miller. Specific problems will be 
discussed prior to consideration of the three questions presented above. 


The Alluisi Taxonomy. Several criticisms were expressed concerning 
this taxonomy: the categories were so broad and general as to afford little 
definition (as, e.g., "intellectual functions"), the categories did not cover. 
sufficient domain (no gross body movement categories provided) , interaction 
processes not covered except by "communications" , and, as a result of both 
overlap and unclear separation, the categories of sensory-perceptual, 
perceptual-motor and watchkeeping were made unnecessarily difficult to use. 
Further, it appeared that if the other categories were defined more the nature 
adequately that "watchkeeping" would either be dropped or redefined. In 
comparison, however, the set of categories in this taxonomy were apparently 
relatively easy to use objectively. The project members indicated that the 
definitions were comparatively clear-cut except for the "intellectual 
functions" category; the reality of this was indicated by the high degree 
of inter-analyst agreement on the mappings except for the aforementioned 
category. 


The Miller Taxonomy. The use of this taxonomy resulted in several 
expressions of dissatisfaction on the part of the analysts. The taxonomic 
categories, or steps, were found to be terribly general, vaguely defined, 
and provided little discrimination between or adequate definition of the 
task items. It was felt that the usefulness of the taxonomy, due to 
and definition of the categories, would necessarily be a function of the 
goodness of the intuition and depth of experience held by the individual 
analyst. 


In applying the taxonomy the analysts found that sequential consid- 
eration of categories like "Concept of Purpose," "Interpretation of Cues," 
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and "Effector Response" imposed the essentially analogous requirements 

of either checking every matrix cell for each task item (because they 
describe the execution process for much of human task behavior; i.e., the 
checking of one step implied the checking of one or more prior steps) or 
checking practically no cells (because they did not discriminate between 
the task items). It was felt that. the procedure of sequential steps might 
be useful in another context, but not at this level with these categories. 
The analysts differed radically in their task item assignments to categor- 
ies as a result of (1) adopting alternate checking procedures (every cell 
vs. no cells for the above mentioned categories) and (2) interpreting the 
definitions of some of the other categories somewhat differently. 


The Meister Taxonomy. As stated above, the level 2 taxonomy was 
developed to provide a more general set of descriptive behavioral 
categories particularly suitable for active space flight tasks. As a 
result, the Rendezvous and Docking task items were easily mapped according 
to the analysts and their category assignments were in close agreement. 
The only criticism seemed to be a feeling that the category, “Perform 
Control-Display Operations" included a much wider range of behaviors than 
the other categories (e.g., "Read Written Material") and would have been 
more satisfactory if separated into two or more categories (e.g., active 
and passive control-display operations categories). 


As would be expected of a taxonomy suitable for description of flight 
tasks, the categories were not adequate for the Inflight Exercise-Work 
Tolerance task items either with respect to completeness or with respect 
to the appropriateness of the category definitions for the task items. 


As a result of the mapping exercise (mapping micro~level task 
descriptions into general-level analytic and descriptive behavioral 
taxonomies) considerable insight was gained with respect to the initial 
set of three questions. The evaluations made by the participating 
analysts of the mapping performance and the results of their activity 
formed the following answers to the questions: 


Question 1. Could the mapping activity be performed? How satisfactory 
was the mapping performance? The answer to the first question seems to 
be "yes". The main question then appears to be, "How satisfactorily can 
the activity be performed in terms of analyst understanding and inter- 
analyst agreement?" As indicated by the taxonomy-specific review above, the 
analysts evidenced fairly close agreement when using the Alluisi and Meister 
taxonomies, Apparently this was a function of the comparatively clearcut 
definitions and examples given by these authors and the relevance of these 
sets of categories to the Rendezvous and Docking activity in particular. 


Question 2. Did the categories serve to adequately describe or 
define and to differentiate between the behaviors? The Aliluisi and 
Meister taxonomies seemed to provide the best definition and to allow the 
most discrimination (although limited in the Alluisi case due to the 
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broadness of his categories) between the task behaviors; although both 
inadequate coverages of the behavioral domain and a possible need for 
redefinitions of the categories were noted for each. The Miller Taxonomy 
seemed to offer very little in the way of description, definition or 
differentiation in the form used. 


Question 3. Did the taxonomies appear to offer any obvious 
advantages or disadvantages? The advantages or disadvantages of a 
taxonomy are most appropriately evaluated by a measure of how well it 
served the purpose for which it was designed. It should, therefore, be 
realized that responses to this question were made primarily with reference 
to the requirements of this project. As has already been pointed out, 
the taxonomies of both Alluisi and Miller were felt to be at too gross a 
level to be particularly useful. In the final evaluation of these two 
taxonomies and the needs of this project it was determined that a taxonomy 
at a greater level of detail would be needed. 


Considering the taxonomies with respect to what advantages they 
might offer, Miller and Alluisi were both viewed with interest as they each 
contained a subset of categories which could be related to the test 
literature, given further detail. Level 2 of the Meister Taxonomy offered 
a level of detail that appeared to collect the task descriptions into units 
that might, e.g., serve certain system analysis, design or evaluation 
purposes » 


Summary 


In summary, the use of each of the three selected taxonomies appeared 
to offer certain benefits. In the process of actually applying these 
taxonomies to a set of task descriptions, however, both strong and weak 
aspects were noted for each. It became clear that the effectiveness and 
usefulness of a taxonomy is a function of at least these things: (1) how 
appropriate the level of detail is to the purpose of the taxonomy, (2) how 
cleanly separated and appropriate the categories are, (3) how objectively 
and thoroughly the categories are defined, and (4) an the case of the 
analytic behavioral categories, how completely the taxonomy covers the 
behavioral domain. 
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